-- Logs begin at Mon 2022-06-20 17:58:17 UTC, end at Mon 2022-06-20 19:13:45 UTC. -- Jun 20 18:37:43.129166 dv-cinder-836973-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 18:37:43.137611 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 18:37:43.139716 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 18:37:43 2022] *** Jun 20 18:37:43.139716 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 18:37:43.139716 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 18:37:43.139716 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: nodename: dv-cinder-836973-6-iscsi Jun 20 18:37:43.139716 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: machine: x86_64 Jun 20 18:37:43.139716 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: clock source: unix Jun 20 18:37:43.139716 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: pcre jit disabled Jun 20 18:37:43.139716 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: detected number of CPU cores: 4 Jun 20 18:37:43.139716 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: current working directory: / Jun 20 18:37:43.139716 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: detected binary path: /usr/bin/uwsgi-core Jun 20 18:37:43.140406 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: your processes number limit is 47680 Jun 20 18:37:43.140406 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: your memory page size is 4096 bytes Jun 20 18:37:43.140406 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: detected max file descriptor number: 2048 Jun 20 18:37:43.140406 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: lock engine: pthread robust mutexes Jun 20 18:37:43.140406 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: thunder lock: enabled Jun 20 18:37:43.140406 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 18:37:43.140406 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 18:37:43.183738 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: Python main interpreter initialized at 0x55adb55c19c0 Jun 20 18:37:43.183738 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: python threads support enabled Jun 20 18:37:43.183738 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: your server socket listen backlog is limited to 100 connections Jun 20 18:37:43.183738 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: your mercy for graceful operations on workers is 90 seconds Jun 20 18:37:43.184077 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 18:37:43.184152 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: *** Operational MODE: preforking *** Jun 20 18:37:43.184384 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: *** uWSGI is running in multiple interpreter mode *** Jun 20 18:37:43.184384 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: spawned uWSGI master process (pid: 109825) Jun 20 18:37:43.184567 dv-cinder-836973-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 18:37:43.185632 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: spawned uWSGI worker 1 (pid: 109826, cores: 1) Jun 20 18:37:43.185632 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: spawned uWSGI worker 2 (pid: 109827, cores: 1) Jun 20 18:37:43.185632 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 18:37:43.841589 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 18:37:43.847974 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 18:37:44.964655 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 18:37:44.964655 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: from cryptography.utils import int_from_bytes Jun 20 18:37:44.965375 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 18:37:44.965375 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: from cryptography.utils import int_from_bytes Jun 20 18:37:44.969751 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 18:37:44.969751 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: from cryptography.utils import int_from_bytes Jun 20 18:37:44.970183 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 18:37:44.970183 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: from cryptography.utils import int_from_bytes Jun 20 18:37:47.465745 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 18:37:47.466313 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 18:37:47.466514 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 18:37:47.466782 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 18:37:47.467184 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 18:37:47.467280 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 18:37:47.467365 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 18:37:47.467536 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.467629 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 18:37:47.467866 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.467967 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 18:37:47.468190 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 18:37:47.468286 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.468509 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.468595 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.468840 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.468934 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.469155 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.469256 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.469480 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.469582 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.469800 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.469894 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.470131 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.470239 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.470427 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.470524 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.470745 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.470829 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.471103 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-6-iscsi {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.471193 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.471382 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.471480 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.471700 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.471826 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.472025 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.472156 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-6-iscsi {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.472344 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.472468 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.472650 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.472779 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.472965 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.473091 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.473269 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.473393 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.473580 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.473763 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.473907 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.474198 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.474313 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.474511 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.474699 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.474823 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.475038 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.475223 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.475406 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.475583 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.475762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.475937 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.476114 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.476331 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.476488 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.476664 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.476876 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.477033 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.477246 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.477491 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.477644 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.477819 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-6-iscsi {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.478032 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.478188 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.478418 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.478577 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.478789 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-6-iscsi {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.478994 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.479180 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.479392 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.479548 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.479731 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.479897 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.480031 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.480266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.480396 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.480554 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.480690 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.480819 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.480962 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.481085 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.481241 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.481403 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.481528 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.481656 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.481777 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.481905 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.482034 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.482161 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.482289 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.482417 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.482577 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.482701 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.482834 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.482970 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.483104 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.483246 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.483378 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.483500 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.483630 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.483760 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.483881 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.484001 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.484122 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.484250 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.484378 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.484509 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.484632 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.484759 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.484888 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.485025 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.485179 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.485344 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.485470 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.485591 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.485726 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.485849 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.486454 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.486584 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.486708 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.486835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.487041 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.487177 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.487300 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.487471 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.487598 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.487781 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.487916 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.488089 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.488224 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.488398 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.488530 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.488707 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.488835 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.489019 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.489153 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.489325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.489451 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.489634 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.489767 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.489942 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.490067 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.490263 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.490403 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.490587 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.490690 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.490892 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.491025 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.491229 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.491328 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.491570 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.491690 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.491891 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.491976 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.492200 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.492297 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.492518 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.492602 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.492841 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.492924 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.493149 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.493255 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.493456 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.493597 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.493762 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.493887 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.494081 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.494221 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.494386 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.494517 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.494695 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.494827 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.494973 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.495105 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.495256 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.495393 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.495562 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.495687 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.495881 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.496006 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.496186 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.496312 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.496492 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.496624 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.496798 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.496924 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.497099 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.497225 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.497405 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.497530 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.497709 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.497834 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.498013 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.498138 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.498315 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.498439 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.498621 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.498745 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.498969 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.499110 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.499234 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.499364 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.499544 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.499670 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.499848 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.499973 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.500153 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.500370 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.500562 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.500687 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.500823 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.500952 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.501072 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.501203 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.501357 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.501484 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.502223 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.502352 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.502533 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.502675 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.502843 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.502987 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.503174 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.503307 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.503498 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.503632 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.503804 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.503934 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.504109 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.504236 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.504430 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.504568 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.504736 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.504860 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.505041 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.505164 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.505360 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.505568 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.505694 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.505823 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.505950 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.506070 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.506261 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.506398 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.506565 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.506696 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.506869 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.507023 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.507198 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.507333 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.507502 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.507628 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.507806 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.507931 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.508110 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.508236 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.508412 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.508537 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.508715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.508840 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.509016 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.509148 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.509318 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.509451 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.509626 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.509753 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.509931 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.510057 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.510235 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.510359 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.510614 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.510762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.510886 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.511028 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.511199 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.511332 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.511507 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.511640 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.511833 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:37:47.511960 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.512170 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.512304 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.512506 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.512668 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.512832 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.512964 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.513144 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.513269 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.513460 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.513595 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.513776 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.513902 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.514103 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.514235 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.514415 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.514541 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.514727 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.514852 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.515062 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.515189 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.515380 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.515516 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.515723 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.515852 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.516011 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.516137 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.516329 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.516462 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.516647 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.516780 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.516966 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.517100 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.517792 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.517930 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.518113 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.518238 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.518436 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.518561 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.518751 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.518877 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.519087 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.519212 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.519427 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.519550 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.519754 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.519888 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.520070 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.520204 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.520396 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.520532 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.520735 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.520881 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.521032 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.521158 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.521352 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.521490 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.521666 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.521792 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.521985 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.522109 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.522300 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.522501 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.522625 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.522745 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.522939 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.523065 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.523259 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.523399 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.523576 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.523716 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.523890 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.524023 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.524205 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.524336 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.524516 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.524640 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.524828 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.524952 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.525145 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.525271 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.525461 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.525595 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.525774 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.525898 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.526092 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.526218 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.526405 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.526531 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.526718 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.526844 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.527052 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.527180 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.527361 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.527515 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.527670 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.527805 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.527979 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.528112 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.528287 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.528411 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.528592 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.528725 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.528896 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.529020 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.529216 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.529340 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.529525 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.529661 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.529850 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.529984 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.530159 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.530284 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.530471 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.530606 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.530849 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.531041 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.531165 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.531285 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.531423 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.531546 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.531726 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.531852 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.532300 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.532488 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.532619 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.532739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.533474 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.533614 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.533794 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.533927 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.534105 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.534232 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.534434 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.534559 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.534745 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.534877 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.535077 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.535206 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.535396 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.535522 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.535707 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.535840 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.536018 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.536144 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.536330 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.536454 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.536644 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.536776 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.536959 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.537086 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.537274 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.537397 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.537587 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.537724 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.537914 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.538041 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.538230 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.538356 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.538544 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.538676 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.538873 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.539041 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.539224 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.539348 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.539537 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.539661 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.539841 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.539966 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.540153 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.540285 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.540460 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.540587 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.540766 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.540906 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.541105 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.541244 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.541376 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.541499 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.541667 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.541793 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.541973 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.542098 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.542275 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.542406 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.542579 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.542702 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.542881 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.543040 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.543212 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.543338 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.543520 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.543639 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.543822 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.543956 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.544127 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.544261 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.544432 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.544558 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.544736 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.544867 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.545043 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.545169 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.545351 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.545478 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.545697 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.545835 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.546005 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.546132 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.546349 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.546476 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.546662 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.546786 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.547007 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.547147 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.547324 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.547450 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.547640 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.547766 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.547954 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.548071 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.548265 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.548388 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.548607 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.548733 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.548920 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.549044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.549238 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.549362 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.549546 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.549673 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.549861 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.549985 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.550173 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.550296 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.550485 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.550610 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.550790 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.550940 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.551144 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.551290 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.551453 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.551578 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.551764 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.551889 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.552082 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.552293 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.552418 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.552544 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.552721 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.552849 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.553038 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.553172 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.553351 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.553476 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.553662 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.553779 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.553972 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.554104 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.554281 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.554405 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.554596 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.554729 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.554906 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.555109 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.555231 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.555350 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.555548 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.555674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.555862 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.555997 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.556174 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.556297 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.556484 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.556615 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.556790 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.556917 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.557106 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.557231 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.557427 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.557550 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.557736 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.557862 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.558053 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.558171 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.558365 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.558489 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.558688 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.558813 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.559024 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.559164 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.559339 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.559472 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.559650 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.559775 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.559959 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.560098 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.560269 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.560403 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.560583 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.560707 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.560895 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.561020 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.561212 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.561346 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.561520 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.561620 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.561827 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.561922 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.562140 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.562244 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.562449 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.562552 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.562756 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.562851 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.563084 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.563180 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.563399 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.563495 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.563706 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.563812 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.564035 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.564143 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.564352 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.564447 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.564674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.564767 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.564982 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.565078 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.565290 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.565386 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.565614 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.565709 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.565921 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.566014 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.566225 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.566318 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.566532 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.566638 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.566838 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.566960 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.567173 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.567275 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.567483 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.567587 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.567791 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.567884 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.568105 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.568216 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.568428 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.568532 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.568735 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.568828 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.569050 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.569142 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.569363 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.569466 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.569674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.569775 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.569990 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.570089 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.570303 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.570409 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.570613 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.570708 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.570943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.571039 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.571265 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.571356 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.571574 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.571668 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.571889 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.571972 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.572205 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.572291 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.572512 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.572604 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.572824 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.572908 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.573136 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.573221 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.573443 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.573527 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.573755 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.573849 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.574071 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.574237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.574383 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.574637 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.574770 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.574992 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.575132 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.575311 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.575575 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.575720 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.575916 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.576061 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.576238 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.576372 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.576563 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.576704 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.576887 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.577028 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.577210 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.577345 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.577529 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.577683 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.577843 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.577978 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.578152 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.578301 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.578607 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.578755 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.578896 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.579071 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.579206 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.579347 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.579478 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.579610 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.580297 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.580431 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.580554 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.580688 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.580811 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.580939 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.581093 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.581219 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.581478 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.581615 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.581749 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.581871 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.581991 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.582121 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.582302 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.582430 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.582615 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.582740 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.582935 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.583066 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.583268 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.583395 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.583580 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.583705 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.583885 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.584034 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.584193 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.584320 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.584499 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.584625 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.584808 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.584940 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.585118 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.585253 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.585428 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.585561 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.585774 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.585913 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.586085 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.586218 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.586412 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.586536 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.586724 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.586859 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.587078 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.587216 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.587390 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.587516 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.587701 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.587836 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.588011 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.588145 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.588326 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.588453 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.588660 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.588794 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.588923 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.589045 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.589233 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.589358 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.589544 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.589670 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.589856 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.589990 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.590167 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.590293 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.590474 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.590601 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.590784 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.590936 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.591121 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.591246 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.591432 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.591573 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.591760 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.591883 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.592038 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.592174 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.592345 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.592471 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.592657 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.592783 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.592964 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.593097 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.593267 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.593391 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.593579 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.593711 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.593881 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.594019 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.594187 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.594304 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.594492 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.594616 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.594797 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.594958 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.595125 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.595249 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.595990 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.596131 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.596304 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.596429 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.596609 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.596733 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.596921 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.597045 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.597235 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.597361 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.597539 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.597663 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.597847 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.597979 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.598156 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.598281 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.598463 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.598611 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.598816 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.598990 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.599129 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.599252 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.599373 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.599568 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.599701 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.599879 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.600007 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.600196 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.600322 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.600525 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.600651 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.600850 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.600985 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.601162 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.601296 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.601470 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.601594 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.601804 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.601939 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.602071 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.602193 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.602370 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.602503 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.602680 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.602806 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.603011 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.603148 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.603323 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.603461 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.603632 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.603759 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.603935 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.604058 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.604241 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.604373 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.604544 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.604668 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.604869 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.604992 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.605179 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.605318 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.605489 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.605615 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.605799 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.605924 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.606167 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.606375 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.606565 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.606687 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.606807 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.606980 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.607118 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.607242 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.607421 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.607547 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.607727 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.607852 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.608042 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.608168 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.608354 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.608479 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.608669 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.608815 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.609013 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.609147 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.609269 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.609398 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.609577 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.609710 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.609890 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.610018 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.610202 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.610329 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.610523 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.610648 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.610875 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.611527 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.611721 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.611859 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.612058 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.612193 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.612316 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.612443 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.612627 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.612753 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.612938 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.613073 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.613253 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.613379 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.613566 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.613699 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.613878 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.614021 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.614190 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.614314 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.614499 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.614631 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.614810 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.614972 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.615142 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.615277 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.615453 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.615585 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.615764 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.615897 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.616074 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.616200 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.616379 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.616512 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.616687 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.616813 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.617001 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.617128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.617305 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.617441 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.617612 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.617738 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.617915 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.618039 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.618227 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.618352 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.618534 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.618667 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.618845 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.619001 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.619189 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.619332 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.619488 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.619614 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.619800 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.619925 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.620176 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.620307 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.620489 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.620610 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.620807 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.620932 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.621122 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.621255 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.621429 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.621553 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.621741 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.621863 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.622068 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.622195 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.622384 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.622482 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.622692 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.622788 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.623064 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.623160 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.623371 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.623456 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.623685 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.623772 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.624009 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.624097 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.624317 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.624409 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.624624 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.624721 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.624928 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.625014 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.625252 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.625338 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.625559 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.625650 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.625869 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.625955 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.626179 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.626271 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.626534 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.627238 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.627409 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.627495 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.627741 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.627881 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.628162 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.628257 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.628480 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.628565 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.628792 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.628876 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.629121 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.629220 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.629447 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.629531 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.629754 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.629837 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.630069 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.630163 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.630379 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.630493 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.630707 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.630853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.631053 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.631183 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.631370 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.631518 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.631692 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.631819 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.631999 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.632148 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.632346 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.632484 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.632614 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.632734 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.632934 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.633065 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.633241 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.633373 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.633569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.633705 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.633895 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.634022 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.634212 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.634347 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.634539 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.634666 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.634900 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.635073 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.635230 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.635358 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.635538 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.635672 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.635849 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.635985 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.636156 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.636283 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.636464 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.636592 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.636790 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.636929 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.637098 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.637231 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.637409 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.637535 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.637716 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.637850 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.638025 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.638149 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.638330 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.638456 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.638639 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.638775 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.638976 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.639104 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.639341 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.639487 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.639620 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.639756 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.639885 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.640008 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.640200 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.640328 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.640510 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.640636 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.640820 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.640946 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.641142 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.641266 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.641451 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.641576 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.641760 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.641887 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.642067 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.642222 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.642439 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.642573 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.642730 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.642855 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.643065 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.643207 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.643376 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.643504 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.643687 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.643813 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.644023 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.644157 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.644332 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.644457 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.644656 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.644782 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.644983 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.645117 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.645305 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.645432 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.645619 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.645745 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.645946 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.646073 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.646253 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.646382 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.646559 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.646685 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.646871 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.647019 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.647201 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.647328 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.647508 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.647634 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.647814 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.647948 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.648123 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.648263 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.648427 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.648555 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.648734 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.648868 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.649038 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.649165 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.649357 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.649569 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.649696 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.649834 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.649959 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.650080 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.650257 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.650394 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.650559 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.650684 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.650866 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.651021 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.651200 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.651341 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.651523 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.651648 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.651835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.651970 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.652147 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.652283 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.652455 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.652659 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.652793 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.652915 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.653102 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.653229 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.653414 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.653542 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.653741 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.653876 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.654074 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.654206 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.654367 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.654495 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.654683 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.654810 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.655022 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.655151 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.655340 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.655469 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.655656 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.655789 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.655971 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.656109 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.656280 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.656412 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.656595 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.656721 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.656911 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.657298 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.657494 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.657623 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.657857 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.658043 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.658171 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.658374 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.658507 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.658691 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.658825 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.659014 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.659333 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.659467 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.659667 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.659793 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.659954 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.660094 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.660269 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.660395 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.660582 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.660709 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.660895 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.661016 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.661208 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.661335 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.661524 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.661650 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.661845 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.661970 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.662141 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.662267 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.662456 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.662583 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.662791 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.662942 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.663132 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.663259 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.663451 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.663588 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.663771 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.663906 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.664104 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.664228 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.664426 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.664560 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.664735 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.664866 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.665055 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.665181 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.665374 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.665502 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.665692 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.665819 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.666006 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.666133 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.666319 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.666446 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.666635 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.666770 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.666974 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.667103 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.667290 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.667419 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.667603 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.667730 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.667919 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.668051 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.668235 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.668360 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.668549 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.668674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.668864 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.669000 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.669189 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.669316 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.669503 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.669627 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.669828 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.669963 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.670124 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.670251 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.670467 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.670642 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.670778 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.670983 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.671107 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.671324 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.671452 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.671687 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.671935 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.672063 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.672254 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.672380 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.672591 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.672717 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.672925 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.673052 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.673221 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.673350 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.674276 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.674403 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.674534 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.674665 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.674788 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.674943 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.675071 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.675206 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.675330 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.675453 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.675581 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.675712 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.675887 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.676026 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.676209 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.676336 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.676522 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.676649 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.676906 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.677039 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.677217 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.677384 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.677542 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.677703 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.677849 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.678033 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.678361 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.678486 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.678682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.678818 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.679013 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.679143 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.679341 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.679468 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.679650 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.679776 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.679987 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.680122 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.680265 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.680391 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.680581 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.680707 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.680889 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.681023 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.681197 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.681322 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.681515 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.681657 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.681825 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.681951 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.682129 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.682255 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.682438 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.682576 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.682740 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.682865 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.683080 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.683207 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.683391 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.683572 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.683696 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.683818 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.683990 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.684115 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.684302 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.684437 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.684609 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.684752 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.684916 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.685050 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.685222 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.685349 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.685528 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.685661 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.685836 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.685960 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.686138 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.686262 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.686444 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.686568 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.686748 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.686880 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.687087 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.687262 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.687656 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.687781 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.687904 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.688027 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.688027 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.688276 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.688399 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.688520 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.688641 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.688769 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.688900 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.689043 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.689794 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.689923 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.690128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.690266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.690418 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.690546 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.690727 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.690852 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.691063 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.691205 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.691380 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.691505 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.691712 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.691845 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.692032 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.692236 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.692367 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.692564 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.692692 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.692887 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.693022 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.693222 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.693518 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.693645 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.693849 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.693964 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.694158 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.694288 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.694464 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.694591 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.694787 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.694937 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.695124 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.695252 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.695438 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.695550 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.695746 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.695864 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.696061 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.696176 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.696374 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.696494 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.696687 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.696807 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.696996 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.697108 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.697307 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.697428 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.697619 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.697738 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.697927 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.698038 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.698418 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.698541 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.698541 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.698746 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.698852 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.698992 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.699157 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.699272 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.699472 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.699585 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.699785 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.699897 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.700172 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.700296 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.700411 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.700517 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.700723 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.700854 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.701034 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.701161 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.701345 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.701465 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.701661 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.701787 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.701970 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.702097 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.702284 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.702410 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.702599 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.702733 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.702933 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.703075 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.703239 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.703367 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.703571 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.703703 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.703906 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.704043 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.704226 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.704353 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.704537 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.704686 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.704905 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.705031 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.705229 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.705362 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.705553 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.705680 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.705866 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.705994 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.706189 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.706315 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.706503 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.706639 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.706834 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.706991 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.707189 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.707314 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.707507 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.707642 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.707819 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.707948 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.708128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.708252 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.708438 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.708573 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.708746 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.708872 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.709058 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.709184 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.709378 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.709517 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.709692 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.709818 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.709997 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.710124 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.710325 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.710463 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.710610 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.710723 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.710965 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.711084 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.711242 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.711364 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.711554 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.711665 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.711858 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.711970 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.712163 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.712275 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.712464 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.712585 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.712770 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.712880 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.713074 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.713364 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.713483 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.713596 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.713700 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.713803 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.714114 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.714236 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.714341 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.714445 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.714548 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.714688 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.714838 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.715005 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.715692 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.715876 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.716025 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.716150 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.716272 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.716394 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.716516 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.716637 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.716767 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.716890 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.717011 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.717133 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.717253 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.717376 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.717506 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.717618 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.717722 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.717842 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.717964 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.718094 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.718217 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.718338 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.718540 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.718673 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.718854 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.719106 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.719232 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.719354 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.719510 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.719637 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.719821 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.719957 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.720134 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.720288 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.720498 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.720634 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.720782 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.720989 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.721115 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.721244 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.721389 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.721516 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.721722 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.721850 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.722051 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.722185 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.722359 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.722495 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.722672 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.722797 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.723009 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.723137 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.723358 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.723483 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.723670 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.723798 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.723982 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.724106 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.724308 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.724443 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.724621 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.724747 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.724931 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.725058 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.725247 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.725375 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.725558 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.725691 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.725869 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.726003 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.726185 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.726319 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.726501 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.726625 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.726814 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.726989 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.727154 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.727282 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.727470 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.727631 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.727789 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.727914 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.728115 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.728249 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.728442 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.728567 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.728756 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.728884 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.729092 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.729219 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.729423 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.729548 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.729740 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.729867 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.730054 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.730181 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.730362 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.730488 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.730688 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 18:37:47.730824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.731078 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.731398 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.731712 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:37:47.731958 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 18:37:47.887237 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO dbcounter [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] Registered counter for database nova_api Jun 20 18:37:47.895792 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO dbcounter [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] Registered counter for database nova_api Jun 20 18:37:47.909050 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_db.sqlalchemy.engines [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:37:47.915567 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writer thread running {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:37:47.916026 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG oslo_db.sqlalchemy.engines [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:37:47.922431 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writer thread running {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:37:47.972378 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.context [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb(cell1) {{(pid=109827) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 18:37:47.976236 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:37:47.977782 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:37:47.978571 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:37:47.979291 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.context [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb(cell1) {{(pid=109826) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 18:37:47.980520 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:37:47.982466 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO dbcounter [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] Registered counter for database nova_cell0 Jun 20 18:37:47.983218 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG oslo_concurrency.lockutils [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:37:47.984796 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG oslo_concurrency.lockutils [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:37:47.985599 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG oslo_concurrency.lockutils [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:37:47.987068 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO dbcounter [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] Registered counter for database nova_cell1 Jun 20 18:37:47.988138 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG oslo_concurrency.lockutils [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:37:47.990097 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO dbcounter [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] Registered counter for database nova_cell0 Jun 20 18:37:47.994176 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO dbcounter [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] Registered counter for database nova_cell1 Jun 20 18:37:47.994778 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_db.sqlalchemy.engines [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:37:47.996451 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_db.sqlalchemy.engines [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:37:48.001506 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG oslo_db.sqlalchemy.engines [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:37:48.002025 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writer thread running {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:37:48.002790 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG oslo_db.sqlalchemy.engines [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:37:48.009309 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writer thread running {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:37:48.010759 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writer thread running {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:37:48.139365 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writer thread running {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:37:48.149530 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO dbcounter [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] Registered counter for database nova_cell0 Jun 20 18:37:48.156177 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_db.sqlalchemy.engines [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:37:48.157406 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO dbcounter [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] Registered counter for database nova_cell0 Jun 20 18:37:48.160754 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writer thread running {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:37:48.166001 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG oslo_db.sqlalchemy.engines [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:37:48.170174 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writer thread running {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:37:48.496015 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: WARNING keystonemiddleware.auth_token [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 18:37:48.498417 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: WARNING keystonemiddleware.auth_token [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 18:37:48.503759 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: WARNING keystonemiddleware.auth_token [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 18:37:48.506261 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: WARNING keystonemiddleware.auth_token [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 18:37:48.839846 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: WARNING keystonemiddleware.auth_token [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 18:37:48.844124 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: WARNING keystonemiddleware.auth_token [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 18:37:48.846217 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: WARNING keystonemiddleware.auth_token [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 18:37:48.850576 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: WARNING keystonemiddleware.auth_token [None req-d0e6f8f7-16f7-4783-892e-f2be1b4e71ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 18:37:48.851458 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55adb55c19c0 pid: 109827 (default app) Jun 20 18:37:48.853512 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:37:48.854689 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001727 Jun 20 18:37:48.855124 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Mon Jun 20 18:37:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:37:48.855836 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55adb55c19c0 pid: 109826 (default app) Jun 20 18:39:03.276162 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:03.277378 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 20 18:39:03.278173 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jun 20 18:39:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:03.292435 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writing DB stats nova_api:SELECT=3 {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:03.293604 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writing DB stats nova_cell0:SELECT=3 {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:03.294365 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writing DB stats nova_cell1:SELECT=3 {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:03.295854 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:03.728518 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-9f141af1-41a7-4c7e-b685-674a13ca005c admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:03.757863 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-9f141af1-41a7-4c7e-b685-674a13ca005c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.470760 Jun 20 18:39:03.758623 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1291 bytes} [Mon Jun 20 18:39:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:39:05.821488 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:05.822479 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-ec850df2-c584-4c76-8a98-b7b43eb8135d None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jun 20 18:39:05.822880 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jun 20 18:39:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:05.881392 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-ff08ce8d-7b3c-4bdb-b504-12872e81af06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "swap": 0, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:05.899203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:39:05.899203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: warnings.warn(msg) Jun 20 18:39:05.932671 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-ff08ce8d-7b3c-4bdb-b504-12872e81af06 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103931 Jun 20 18:39:05.934955 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jun 20 18:39:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 18:39:05.947862 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_api:SELECT=3 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:05.948745 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_cell1:SELECT=3 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:05.949758 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_cell0:SELECT=3 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:05.950537 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:06.161563 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-b5f0839d-78b6-4b19-9f77-d07f4c0e3a0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:06.163993 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:39:06.163993 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: warnings.warn(msg) Jun 20 18:39:06.223869 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-b5f0839d-78b6-4b19-9f77-d07f4c0e3a0a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281723 Jun 20 18:39:06.224529 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Jun 20 18:39:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:39:08.291205 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-ff08ce8d-7b3c-4bdb-b504-12872e81af06 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:08.292368 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-ff08ce8d-7b3c-4bdb-b504-12872e81af06 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001691 Jun 20 18:39:08.292839 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jun 20 18:39:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:08.397676 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-b81da54f-40b2-4fec-bbdc-366f4a14faa1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5, "id": "d1", "rxtx_factor": 1.0, "ram": 512, "swap": 0}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:08.415296 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:39:08.415296 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: warnings.warn(msg) Jun 20 18:39:08.433338 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-b81da54f-40b2-4fec-bbdc-366f4a14faa1 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134619 Jun 20 18:39:08.433882 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jun 20 18:39:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:39:08.449223 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-c75ae29d-9ca2-42f3-b740-817a90f54b52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:08.451120 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:39:08.451120 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: warnings.warn(msg) Jun 20 18:39:08.481684 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-c75ae29d-9ca2-42f3-b740-817a90f54b52 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039077 Jun 20 18:39:08.483115 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Jun 20 18:39:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:39:10.562276 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-b81da54f-40b2-4fec-bbdc-366f4a14faa1 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:10.563367 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-b81da54f-40b2-4fec-bbdc-366f4a14faa1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 20 18:39:10.563774 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jun 20 18:39:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:10.623835 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-0d25b90b-91f0-45a9-874e-64afac8280f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:10.643525 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-0d25b90b-91f0-45a9-874e-64afac8280f8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073773 Jun 20 18:39:10.644173 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jun 20 18:39:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 18:39:10.656494 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-b23445b2-0961-4fdd-b48e-f833bc179bca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:10.682735 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-b23445b2-0961-4fdd-b48e-f833bc179bca admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030459 Jun 20 18:39:10.683418 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Jun 20 18:39:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:39:12.815984 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-0d25b90b-91f0-45a9-874e-64afac8280f8 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:12.817000 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-0d25b90b-91f0-45a9-874e-64afac8280f8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 20 18:39:12.817400 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jun 20 18:39:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:12.874224 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-9dc055cc-7a11-4c94-ae73-9ef1f1eee6a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:12.893272 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-9dc055cc-7a11-4c94-ae73-9ef1f1eee6a4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070280 Jun 20 18:39:12.893810 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jun 20 18:39:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 18:39:12.906100 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-4c5a7278-14cf-44f3-965d-0037325ef0ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:12.928096 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-4c5a7278-14cf-44f3-965d-0037325ef0ff admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026250 Jun 20 18:39:12.928807 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Jun 20 18:39:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:39:14.994850 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-9dc055cc-7a11-4c94-ae73-9ef1f1eee6a4 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:14.995888 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-9dc055cc-7a11-4c94-ae73-9ef1f1eee6a4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 20 18:39:14.996282 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jun 20 18:39:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:15.054935 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-635ce68a-5de1-4010-93d0-2a76cfa10a5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "id": "d4", "rxtx_factor": 1.0}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:15.072033 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-635ce68a-5de1-4010-93d0-2a76cfa10a5d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070115 Jun 20 18:39:15.073204 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jun 20 18:39:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:39:15.087880 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-966d9e15-f8df-490e-a300-1092ee8b3671 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:15.110150 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-966d9e15-f8df-490e-a300-1092ee8b3671 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025924 Jun 20 18:39:15.110861 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Jun 20 18:39:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:39:17.187281 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-635ce68a-5de1-4010-93d0-2a76cfa10a5d admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:17.188297 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-635ce68a-5de1-4010-93d0-2a76cfa10a5d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jun 20 18:39:17.188697 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jun 20 18:39:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:17.248277 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-5ef23e8b-37cd-4a79-bb9b-46379673e81c admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:17.272195 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-5ef23e8b-37cd-4a79-bb9b-46379673e81c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077492 Jun 20 18:39:17.272875 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1291 bytes} [Mon Jun 20 18:39:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:39:19.402969 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-635ce68a-5de1-4010-93d0-2a76cfa10a5d admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:19.403983 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-635ce68a-5de1-4010-93d0-2a76cfa10a5d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 20 18:39:19.404381 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jun 20 18:39:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:19.471805 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-7665b400-623b-4c09-92a9-6a54bab89d8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "swap": 0}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:19.491853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-7665b400-623b-4c09-92a9-6a54bab89d8d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080744 Jun 20 18:39:19.492599 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jun 20 18:39:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:39:19.505651 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-a97b013b-19ce-4cb0-9d3c-b4c3d114fbd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:19.528473 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-a97b013b-19ce-4cb0-9d3c-b4c3d114fbd7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026484 Jun 20 18:39:19.529028 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Jun 20 18:39:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:39:22.206131 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-7665b400-623b-4c09-92a9-6a54bab89d8d admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:22.207175 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-7665b400-623b-4c09-92a9-6a54bab89d8d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 20 18:39:22.207567 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jun 20 18:39:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:22.265170 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-e7ffa94d-5feb-4f6a-be5c-620b972b2996 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:22.282785 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-e7ffa94d-5feb-4f6a-be5c-620b972b2996 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069202 Jun 20 18:39:22.283362 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jun 20 18:39:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 18:39:22.295235 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-56c06ac5-5091-49bb-8b02-8d910c86c3b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:22.317514 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-56c06ac5-5091-49bb-8b02-8d910c86c3b6 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026083 Jun 20 18:39:22.318109 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Jun 20 18:39:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:39:24.364887 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-e7ffa94d-5feb-4f6a-be5c-620b972b2996 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:24.365894 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-e7ffa94d-5feb-4f6a-be5c-620b972b2996 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 20 18:39:24.366288 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jun 20 18:39:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:24.431878 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-b592464b-1cfb-44d3-9e55-f6434052fa14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "disk": 40}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:24.450381 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-b592464b-1cfb-44d3-9e55-f6434052fa14 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.078169 Jun 20 18:39:24.450950 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jun 20 18:39:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 18:39:24.462770 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b3aa1c3e-80ca-41ae-98e6-7478fa4cbfbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:24.485845 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-b3aa1c3e-80ca-41ae-98e6-7478fa4cbfbb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026806 Jun 20 18:39:24.486399 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Jun 20 18:39:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:39:26.556007 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-b592464b-1cfb-44d3-9e55-f6434052fa14 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:26.557000 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-b592464b-1cfb-44d3-9e55-f6434052fa14 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 20 18:39:26.557394 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jun 20 18:39:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:26.615679 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-fb8c5822-ef12-4906-ac02-c38b4d037362 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0, "swap": 0, "id": "4", "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:26.633828 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-fb8c5822-ef12-4906-ac02-c38b4d037362 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070621 Jun 20 18:39:26.634375 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jun 20 18:39:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 18:39:26.646384 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-2253aae4-21fb-4b37-b3cc-53688c3868c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:26.668715 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-2253aae4-21fb-4b37-b3cc-53688c3868c5 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026021 Jun 20 18:39:26.669290 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Jun 20 18:39:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:39:28.750719 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-fb8c5822-ef12-4906-ac02-c38b4d037362 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:28.751749 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-fb8c5822-ef12-4906-ac02-c38b4d037362 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 20 18:39:28.752143 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jun 20 18:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:28.820021 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-a4c1619c-bbc7-49e1-b194-317c6e91287b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "swap": 0, "vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:28.838584 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-a4c1619c-bbc7-49e1-b194-317c6e91287b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080511 Jun 20 18:39:28.839161 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jun 20 18:39:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:39:28.851089 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-3973e4d4-6048-4278-a88b-49afd2d39ce0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:28.876457 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-3973e4d4-6048-4278-a88b-49afd2d39ce0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029306 Jun 20 18:39:28.877023 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Jun 20 18:39:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:39:52.952118 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-a4c1619c-bbc7-49e1-b194-317c6e91287b admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:52.953117 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-a4c1619c-bbc7-49e1-b194-317c6e91287b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 20 18:39:52.953512 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jun 20 18:39:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:52.963829 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:53.011463 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-fd72eb64-0efb-4f46-9f02-6e14feeef8a2 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:53.028024 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-fd72eb64-0efb-4f46-9f02-6e14feeef8a2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068782 Jun 20 18:39:53.028548 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1291 bytes} [Mon Jun 20 18:39:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:39:53.934497 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-a4c1619c-bbc7-49e1-b194-317c6e91287b admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:53.935532 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-a4c1619c-bbc7-49e1-b194-317c6e91287b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 20 18:39:53.935977 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jun 20 18:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:54.124260 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-ca587813-2ed2-4c5e-b3d5-ca74605e6e18 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:54.129785 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.wsgi [None req-ca587813-2ed2-4c5e-b3d5-ca74605e6e18 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-ca587813-2ed2-4c5e-b3d5-ca74605e6e18 admin admin] Request method failure captured: Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Accept: application/json Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Accept-Encoding: gzip, deflate Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Connection: keep-alive Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Content-Length: 0 Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Host: 10.222.0.43 Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Openstack-Api-Version: compute 2.90 Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Openstack-System-Scope: None Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: User-Agent: python-novaclient Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Auth-Token: gAAAAABisL75M4_anF8qk37GR11t-rvUhpibV2LS40WDmTTrbp0o9J_iQ-X6W1bEHL5hOqcdKI0asEIf_gJxrqQmku23QgW0dHp09e3bbBhke-lJ8AiDpH8CfeTNX5yE4fNXV0l2HhXtCBJqUfaw_lbJcaAyIm26f3W9-d6mYybFvhhEzG_2nEs Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Domain-Id: None Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Domain-Name: None Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Identity-Status: Confirmed Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Is-Admin-Project: True Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Project-Domain-Id: default Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Project-Domain-Name: Default Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Project-Id: a0b525758c904932afef5b70ff9bce58 Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Project-Name: admin Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Role: member,reader,admin Jun 20 18:39:54.133056 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Roles: member,reader,admin Jun 20 18:39:54.134682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0b525758c904932afef5b70ff9bce58", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0b525758c904932afef5b70ff9bce58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b525758c904932afef5b70ff9bce58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b525758c904932afef5b70ff9bce58"}]}] Jun 20 18:39:54.134682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Tenant: admin Jun 20 18:39:54.134682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Tenant-Id: a0b525758c904932afef5b70ff9bce58 Jun 20 18:39:54.134682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Tenant-Name: admin Jun 20 18:39:54.134682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User: admin Jun 20 18:39:54.134682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User-Domain-Id: default Jun 20 18:39:54.134682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User-Domain-Name: Default Jun 20 18:39:54.134682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User-Id: f899d83db9084c5aa9d23df884d32076 Jun 20 18:39:54.134682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User-Name: admin Jun 20 18:39:54.134682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: method: > Jun 20 18:39:54.134682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: exception: Flavor 42 could not be found. Jun 20 18:39:54.134682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: action_args: {'id': '42'} Jun 20 18:39:54.134682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:39:54.134682 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:39:54.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:54.137128 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-ca587813-2ed2-4c5e-b3d5-ca74605e6e18 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:39:54.138474 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-ca587813-2ed2-4c5e-b3d5-ca74605e6e18 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061207 Jun 20 18:39:54.138474 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Jun 20 18:39:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:54.144288 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-900d53e9-bbfa-4925-b415-f6f823170bf4 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:54.147227 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:54.167072 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-900d53e9-bbfa-4925-b415-f6f823170bf4 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026256 Jun 20 18:39:54.167601 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Jun 20 18:39:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:39:54.177060 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-91738343-4eaa-40f8-9a0f-f06d4b253c4e admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:54.199256 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-91738343-4eaa-40f8-9a0f-f06d4b253c4e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025722 Jun 20 18:39:54.199784 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Jun 20 18:39:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:39:54.209181 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-abb89520-0248-4b1c-923f-3cc7d7456d1b admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:54.215385 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.wsgi [None req-abb89520-0248-4b1c-923f-3cc7d7456d1b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-abb89520-0248-4b1c-923f-3cc7d7456d1b admin admin] Request method failure captured: Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Accept: application/json Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Accept-Encoding: gzip, deflate Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Connection: keep-alive Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Content-Length: 0 Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Host: 10.222.0.43 Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Openstack-Api-Version: compute 2.90 Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Openstack-System-Scope: None Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: User-Agent: python-novaclient Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Auth-Token: gAAAAABisL75M4_anF8qk37GR11t-rvUhpibV2LS40WDmTTrbp0o9J_iQ-X6W1bEHL5hOqcdKI0asEIf_gJxrqQmku23QgW0dHp09e3bbBhke-lJ8AiDpH8CfeTNX5yE4fNXV0l2HhXtCBJqUfaw_lbJcaAyIm26f3W9-d6mYybFvhhEzG_2nEs Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Domain-Id: None Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Domain-Name: None Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Identity-Status: Confirmed Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Is-Admin-Project: True Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Project-Domain-Id: default Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Project-Domain-Name: Default Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Project-Id: a0b525758c904932afef5b70ff9bce58 Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Project-Name: admin Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Role: member,reader,admin Jun 20 18:39:54.219266 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Roles: member,reader,admin Jun 20 18:39:54.220762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0b525758c904932afef5b70ff9bce58", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0b525758c904932afef5b70ff9bce58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b525758c904932afef5b70ff9bce58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b525758c904932afef5b70ff9bce58"}]}] Jun 20 18:39:54.220762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Tenant: admin Jun 20 18:39:54.220762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Tenant-Id: a0b525758c904932afef5b70ff9bce58 Jun 20 18:39:54.220762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Tenant-Name: admin Jun 20 18:39:54.220762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User: admin Jun 20 18:39:54.220762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User-Domain-Id: default Jun 20 18:39:54.220762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User-Domain-Name: Default Jun 20 18:39:54.220762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User-Id: f899d83db9084c5aa9d23df884d32076 Jun 20 18:39:54.220762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User-Name: admin Jun 20 18:39:54.220762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: method: > Jun 20 18:39:54.220762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: exception: Flavor 42 could not be found. Jun 20 18:39:54.220762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: action_args: {'id': '42'} Jun 20 18:39:54.220762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:39:54.220762 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:39:54.221739 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:54.222824 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-abb89520-0248-4b1c-923f-3cc7d7456d1b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:39:54.223868 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-abb89520-0248-4b1c-923f-3cc7d7456d1b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014947 Jun 20 18:39:54.223868 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Jun 20 18:39:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:55.030719 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-91738343-4eaa-40f8-9a0f-f06d4b253c4e admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:55.031801 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-91738343-4eaa-40f8-9a0f-f06d4b253c4e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002139 Jun 20 18:39:55.032198 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jun 20 18:39:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:55.221849 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-2e006519-ef86-4d14-8e66-c50f506403b6 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:55.227244 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.wsgi [None req-2e006519-ef86-4d14-8e66-c50f506403b6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-2e006519-ef86-4d14-8e66-c50f506403b6 admin admin] Request method failure captured: Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Accept: application/json Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Accept-Encoding: gzip, deflate Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Connection: keep-alive Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Content-Length: 0 Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Host: 10.222.0.43 Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Openstack-Api-Version: compute 2.90 Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Openstack-System-Scope: None Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: User-Agent: python-novaclient Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Auth-Token: gAAAAABisL77qQZ9xKA0chkY56sreqviREtKLdXt-uF2E5Y1ONCiaaCt3O8wRVPrvb757zNj4yOl5DtHhM12HxRvUzi8xh9uKc3mnUft5dn3z4gPapNaIoFrviEpRGCH3pJZkXX7lhT87hkyNzWVszOpc3MT1HHp3-6ZyXZfoycxxnsQuzDEVhE Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Domain-Id: None Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Domain-Name: None Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Identity-Status: Confirmed Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Is-Admin-Project: True Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Project-Domain-Id: default Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Project-Domain-Name: Default Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Project-Id: a0b525758c904932afef5b70ff9bce58 Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Project-Name: admin Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Role: member,reader,admin Jun 20 18:39:55.228744 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Roles: member,reader,admin Jun 20 18:39:55.230325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0b525758c904932afef5b70ff9bce58", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0b525758c904932afef5b70ff9bce58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b525758c904932afef5b70ff9bce58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b525758c904932afef5b70ff9bce58"}]}] Jun 20 18:39:55.230325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Tenant: admin Jun 20 18:39:55.230325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Tenant-Id: a0b525758c904932afef5b70ff9bce58 Jun 20 18:39:55.230325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Tenant-Name: admin Jun 20 18:39:55.230325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User: admin Jun 20 18:39:55.230325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User-Domain-Id: default Jun 20 18:39:55.230325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User-Domain-Name: Default Jun 20 18:39:55.230325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User-Id: f899d83db9084c5aa9d23df884d32076 Jun 20 18:39:55.230325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User-Name: admin Jun 20 18:39:55.230325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: method: > Jun 20 18:39:55.230325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: exception: Flavor 84 could not be found. Jun 20 18:39:55.230325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: action_args: {'id': '84'} Jun 20 18:39:55.230325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:39:55.230325 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:39:55.231405 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:55.232835 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-2e006519-ef86-4d14-8e66-c50f506403b6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:39:55.234179 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-2e006519-ef86-4d14-8e66-c50f506403b6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061275 Jun 20 18:39:55.234179 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Jun 20 18:39:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:55.240444 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-f6119c75-4097-4c71-a759-8c0f910b769b admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:55.256086 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-f6119c75-4097-4c71-a759-8c0f910b769b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019747 Jun 20 18:39:55.256620 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Jun 20 18:39:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:39:55.266812 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-8f63d6ec-8210-4f7f-b099-75ef97ca7926 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:55.282179 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-8f63d6ec-8210-4f7f-b099-75ef97ca7926 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019624 Jun 20 18:39:55.282712 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Jun 20 18:39:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:39:55.292324 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-0d45cdb2-93c6-4c19-99d5-d360b292d460 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:55.297717 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.wsgi [None req-0d45cdb2-93c6-4c19-99d5-d360b292d460 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-0d45cdb2-93c6-4c19-99d5-d360b292d460 admin admin] Request method failure captured: Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Accept: application/json Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Accept-Encoding: gzip, deflate Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Connection: keep-alive Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Content-Length: 0 Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Host: 10.222.0.43 Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Openstack-Api-Version: compute 2.90 Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Openstack-System-Scope: None Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: User-Agent: python-novaclient Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Auth-Token: gAAAAABisL77qQZ9xKA0chkY56sreqviREtKLdXt-uF2E5Y1ONCiaaCt3O8wRVPrvb757zNj4yOl5DtHhM12HxRvUzi8xh9uKc3mnUft5dn3z4gPapNaIoFrviEpRGCH3pJZkXX7lhT87hkyNzWVszOpc3MT1HHp3-6ZyXZfoycxxnsQuzDEVhE Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Domain-Id: None Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Domain-Name: None Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Identity-Status: Confirmed Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Is-Admin-Project: True Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Project-Domain-Id: default Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Project-Domain-Name: Default Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Project-Id: a0b525758c904932afef5b70ff9bce58 Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Project-Name: admin Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Role: member,reader,admin Jun 20 18:39:55.299237 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Roles: member,reader,admin Jun 20 18:39:55.300715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0b525758c904932afef5b70ff9bce58", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0b525758c904932afef5b70ff9bce58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b525758c904932afef5b70ff9bce58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b525758c904932afef5b70ff9bce58"}]}] Jun 20 18:39:55.300715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Tenant: admin Jun 20 18:39:55.300715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Tenant-Id: a0b525758c904932afef5b70ff9bce58 Jun 20 18:39:55.300715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Tenant-Name: admin Jun 20 18:39:55.300715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User: admin Jun 20 18:39:55.300715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User-Domain-Id: default Jun 20 18:39:55.300715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User-Domain-Name: Default Jun 20 18:39:55.300715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User-Id: f899d83db9084c5aa9d23df884d32076 Jun 20 18:39:55.300715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User-Name: admin Jun 20 18:39:55.300715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: method: > Jun 20 18:39:55.300715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: exception: Flavor 84 could not be found. Jun 20 18:39:55.300715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: action_args: {'id': '84'} Jun 20 18:39:55.300715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:39:55.300715 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:39:55.301674 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:55.302943 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-0d45cdb2-93c6-4c19-99d5-d360b292d460 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:39:55.304165 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-0d45cdb2-93c6-4c19-99d5-d360b292d460 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011819 Jun 20 18:39:55.304165 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Jun 20 18:39:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 20 18:39:56.135885 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-8f63d6ec-8210-4f7f-b099-75ef97ca7926 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:56.136871 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-8f63d6ec-8210-4f7f-b099-75ef97ca7926 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Jun 20 18:39:56.137254 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jun 20 18:39:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:56.325967 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-e3f2a635-a148-4503-920d-12b825de14a8 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:56.332138 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.wsgi [None req-e3f2a635-a148-4503-920d-12b825de14a8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-e3f2a635-a148-4503-920d-12b825de14a8 admin admin] Request method failure captured: Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Accept: application/json Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Accept-Encoding: gzip, deflate Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Connection: keep-alive Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Content-Length: 0 Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Host: 10.222.0.43 Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Openstack-Api-Version: compute 2.90 Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Openstack-System-Scope: None Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: User-Agent: python-novaclient Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Auth-Token: gAAAAABisL78OXTM0R7xjHlorLi7seH2FD08d7ClzBVqKRp9sYD_p0JtaxxIU9vBTrZzAmn9cvTstH13PIk7HQRxaIf93b6tOq8HyvAal7Zd6tCLLdLlNhLajWNhiJGYjhKIBHPNEu_PEXoPFFiS_ddX7Q7OgSjDDu3EIhqjJAaLtkf7EH1UYl4 Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Domain-Id: None Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Domain-Name: None Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Identity-Status: Confirmed Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Is-Admin-Project: True Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Project-Domain-Id: default Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Project-Domain-Name: Default Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Project-Id: a0b525758c904932afef5b70ff9bce58 Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Project-Name: admin Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Role: member,reader,admin Jun 20 18:39:56.333625 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Roles: member,reader,admin Jun 20 18:39:56.335203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0b525758c904932afef5b70ff9bce58", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0b525758c904932afef5b70ff9bce58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b525758c904932afef5b70ff9bce58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b525758c904932afef5b70ff9bce58"}]}] Jun 20 18:39:56.335203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Tenant: admin Jun 20 18:39:56.335203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Tenant-Id: a0b525758c904932afef5b70ff9bce58 Jun 20 18:39:56.335203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-Tenant-Name: admin Jun 20 18:39:56.335203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User: admin Jun 20 18:39:56.335203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User-Domain-Id: default Jun 20 18:39:56.335203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User-Domain-Name: Default Jun 20 18:39:56.335203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User-Id: f899d83db9084c5aa9d23df884d32076 Jun 20 18:39:56.335203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: X-User-Name: admin Jun 20 18:39:56.335203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: method: > Jun 20 18:39:56.335203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: exception: Flavor 451 could not be found. Jun 20 18:39:56.335203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: action_args: {'id': '451'} Jun 20 18:39:56.335203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:39:56.335203 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:39:56.336177 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jun 20 18:39:56.337693 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-e3f2a635-a148-4503-920d-12b825de14a8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:39:56.338971 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-e3f2a635-a148-4503-920d-12b825de14a8 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062170 Jun 20 18:39:56.338971 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Jun 20 18:39:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:56.345078 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-0b373237-0c56-409c-9b7d-3dcfe1160e65 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:56.359004 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-0b373237-0c56-409c-9b7d-3dcfe1160e65 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018082 Jun 20 18:39:56.359528 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Jun 20 18:39:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:39:56.368459 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b572555a-79ba-4a46-beaf-a8f4673826fd admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:56.381659 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-b572555a-79ba-4a46-beaf-a8f4673826fd admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016637 Jun 20 18:39:56.382159 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Jun 20 18:39:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:39:56.391394 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-7cd58a43-fd19-4ba0-942a-86d0810a65d6 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:56.396557 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.wsgi [None req-7cd58a43-fd19-4ba0-942a-86d0810a65d6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-7cd58a43-fd19-4ba0-942a-86d0810a65d6 admin admin] Request method failure captured: Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Accept: application/json Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Accept-Encoding: gzip, deflate Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Connection: keep-alive Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Content-Length: 0 Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Host: 10.222.0.43 Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Openstack-Api-Version: compute 2.90 Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Openstack-System-Scope: None Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: User-Agent: python-novaclient Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Auth-Token: gAAAAABisL78OXTM0R7xjHlorLi7seH2FD08d7ClzBVqKRp9sYD_p0JtaxxIU9vBTrZzAmn9cvTstH13PIk7HQRxaIf93b6tOq8HyvAal7Zd6tCLLdLlNhLajWNhiJGYjhKIBHPNEu_PEXoPFFiS_ddX7Q7OgSjDDu3EIhqjJAaLtkf7EH1UYl4 Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Domain-Id: None Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Domain-Name: None Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Identity-Status: Confirmed Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Is-Admin-Project: True Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Project-Domain-Id: default Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Project-Domain-Name: Default Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Project-Id: a0b525758c904932afef5b70ff9bce58 Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Project-Name: admin Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Role: member,reader,admin Jun 20 18:39:56.398044 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Roles: member,reader,admin Jun 20 18:39:56.399622 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0b525758c904932afef5b70ff9bce58", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0b525758c904932afef5b70ff9bce58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b525758c904932afef5b70ff9bce58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b525758c904932afef5b70ff9bce58"}]}] Jun 20 18:39:56.399622 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Tenant: admin Jun 20 18:39:56.399622 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Tenant-Id: a0b525758c904932afef5b70ff9bce58 Jun 20 18:39:56.399622 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-Tenant-Name: admin Jun 20 18:39:56.399622 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User: admin Jun 20 18:39:56.399622 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User-Domain-Id: default Jun 20 18:39:56.399622 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User-Domain-Name: Default Jun 20 18:39:56.399622 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User-Id: f899d83db9084c5aa9d23df884d32076 Jun 20 18:39:56.399622 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: X-User-Name: admin Jun 20 18:39:56.399622 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: method: > Jun 20 18:39:56.399622 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: exception: Flavor 451 could not be found. Jun 20 18:39:56.399622 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: action_args: {'id': '451'} Jun 20 18:39:56.399622 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:39:56.399622 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:39:56.400569 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jun 20 18:39:56.401853 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-7cd58a43-fd19-4ba0-942a-86d0810a65d6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:39:56.403081 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-7cd58a43-fd19-4ba0-942a-86d0810a65d6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011936 Jun 20 18:39:56.403081 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Jun 20 18:39:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:57.208702 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b572555a-79ba-4a46-beaf-a8f4673826fd admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:57.209701 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-b572555a-79ba-4a46-beaf-a8f4673826fd admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 20 18:39:57.210087 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jun 20 18:39:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:57.408753 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-44273881-1da1-4579-9919-c09a810844a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:57.426022 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-44273881-1da1-4579-9919-c09a810844a5 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071134 Jun 20 18:39:57.426488 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Jun 20 18:39:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:39:58.269187 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b572555a-79ba-4a46-beaf-a8f4673826fd admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:58.270214 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-b572555a-79ba-4a46-beaf-a8f4673826fd admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 20 18:39:58.270602 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jun 20 18:39:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:58.458757 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-85d630cf-09e0-421d-822c-ae526a176f7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:58.476250 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-85d630cf-09e0-421d-822c-ae526a176f7d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067868 Jun 20 18:39:58.476782 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Jun 20 18:39:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:39:59.300144 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b572555a-79ba-4a46-beaf-a8f4673826fd admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:39:59.301167 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-b572555a-79ba-4a46-beaf-a8f4673826fd admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 20 18:39:59.301561 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jun 20 18:39:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:39:59.491168 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-cdbdff97-e30f-4b83-a3ed-ac0991ae31d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:39:59.508472 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-cdbdff97-e30f-4b83-a3ed-ac0991ae31d2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068850 Jun 20 18:39:59.509003 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Jun 20 18:39:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:40:00.344780 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b572555a-79ba-4a46-beaf-a8f4673826fd admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:40:00.345789 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-b572555a-79ba-4a46-beaf-a8f4673826fd admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 20 18:40:00.346184 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jun 20 18:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:40:00.535369 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-1d367c75-49f7-4594-a3b7-4ee90e296f86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:40:00.552776 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-1d367c75-49f7-4594-a3b7-4ee90e296f86 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069600 Jun 20 18:40:00.553746 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Jun 20 18:40:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 18:40:01.372496 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b572555a-79ba-4a46-beaf-a8f4673826fd admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:40:01.373566 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-b572555a-79ba-4a46-beaf-a8f4673826fd admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 20 18:40:01.373965 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jun 20 18:40:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:40:01.567182 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-5586e8be-70cd-4e25-95db-0f4b4d60390d admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:40:01.585919 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-5586e8be-70cd-4e25-95db-0f4b4d60390d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072348 Jun 20 18:40:01.586381 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Mon Jun 20 18:40:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:40:47.651287 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b572555a-79ba-4a46-beaf-a8f4673826fd admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:40:47.652296 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-b572555a-79ba-4a46-beaf-a8f4673826fd admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 20 18:40:47.652690 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jun 20 18:40:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:40:47.663452 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:40:47.711984 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-b0828510-2c15-40b5-a1d6-60c92104e8b5 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:40:47.731650 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-b0828510-2c15-40b5-a1d6-60c92104e8b5 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072854 Jun 20 18:40:47.732172 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1291 bytes} [Mon Jun 20 18:40:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:40:47.755860 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-5e60e661-a305-47bc-a65e-55828a127ebd admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:40:47.759337 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writing DB stats nova_api:SELECT=14 {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:40:47.764543 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-5e60e661-a305-47bc-a65e-55828a127ebd admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012302 Jun 20 18:40:47.765046 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1282 bytes} [Mon Jun 20 18:40:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:40:47.776270 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-f27f2360-37b3-4172-ba8e-6f28524fa89c admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:40:47.784407 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-f27f2360-37b3-4172-ba8e-6f28524fa89c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011611 Jun 20 18:40:47.784901 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1285 bytes} [Mon Jun 20 18:40:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:40:47.796279 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-dc25cd95-d920-4432-862d-050af214cd9c admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:40:47.803687 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-dc25cd95-d920-4432-862d-050af214cd9c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011440 Jun 20 18:40:47.804185 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1285 bytes} [Mon Jun 20 18:40:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:40:47.815089 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-bbe156c5-cae2-4cc3-8148-65c6e2ddebe9 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:40:47.822336 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-bbe156c5-cae2-4cc3-8148-65c6e2ddebe9 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010613 Jun 20 18:40:47.822842 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1282 bytes} [Mon Jun 20 18:40:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:44:06.024741 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-dc25cd95-d920-4432-862d-050af214cd9c admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:44:06.025754 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-dc25cd95-d920-4432-862d-050af214cd9c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 20 18:44:06.026173 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jun 20 18:44:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:44:06.165264 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_api:SELECT=6 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:44:06.277047 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-1011aaec-8f3d-4c03-9283-c496a4adb946 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:44:06.278213 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:44:06.278213 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: warnings.warn(msg) Jun 20 18:44:06.279459 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-1011aaec-8f3d-4c03-9283-c496a4adb946 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:44:06.279920 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-1011aaec-8f3d-4c03-9283-c496a4adb946 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:44:06.280710 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-1011aaec-8f3d-4c03-9283-c496a4adb946 admin admin] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:44:06.281135 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-1011aaec-8f3d-4c03-9283-c496a4adb946 admin admin] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:44:06.318009 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-1011aaec-8f3d-4c03-9283-c496a4adb946 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154025 Jun 20 18:44:06.318900 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Jun 20 18:44:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:44:07.136357 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-dc25cd95-d920-4432-862d-050af214cd9c admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:44:07.137360 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-dc25cd95-d920-4432-862d-050af214cd9c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 20 18:44:07.137773 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jun 20 18:44:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:44:07.325869 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-81c4dbe1-be44-4625-b452-f7c888e8222d admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:44:07.327065 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:44:07.327065 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: warnings.warn(msg) Jun 20 18:44:07.328279 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-81c4dbe1-be44-4625-b452-f7c888e8222d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:44:07.328720 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-81c4dbe1-be44-4625-b452-f7c888e8222d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:44:07.329518 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-81c4dbe1-be44-4625-b452-f7c888e8222d admin admin] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:44:07.329973 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-81c4dbe1-be44-4625-b452-f7c888e8222d admin admin] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:44:07.349147 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-81c4dbe1-be44-4625-b452-f7c888e8222d admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074648 Jun 20 18:44:07.349652 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Jun 20 18:44:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:44:18.580672 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-dc25cd95-d920-4432-862d-050af214cd9c admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:44:18.581670 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-dc25cd95-d920-4432-862d-050af214cd9c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 20 18:44:18.582052 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jun 20 18:44:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:44:18.723778 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_cell0:SELECT=4 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:44:18.724501 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_cell1:SELECT=4 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:44:18.725215 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_api:SELECT=8 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:44:18.772863 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-db0829ba-6fe8-40a3-81f7-e8cd6c3bb242 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:44:18.774032 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:44:18.774032 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: warnings.warn(msg) Jun 20 18:44:18.775250 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-db0829ba-6fe8-40a3-81f7-e8cd6c3bb242 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:44:18.775749 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-db0829ba-6fe8-40a3-81f7-e8cd6c3bb242 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:44:18.776532 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-db0829ba-6fe8-40a3-81f7-e8cd6c3bb242 admin admin] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:44:18.776960 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-db0829ba-6fe8-40a3-81f7-e8cd6c3bb242 admin admin] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:44:18.801825 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-db0829ba-6fe8-40a3-81f7-e8cd6c3bb242 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082474 Jun 20 18:44:18.802309 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 38/74] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Jun 20 18:44:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:44:19.614710 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-dc25cd95-d920-4432-862d-050af214cd9c admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:44:19.615746 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-dc25cd95-d920-4432-862d-050af214cd9c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 20 18:44:19.616135 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 37/75] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jun 20 18:44:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:44:19.804568 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-492f64a2-3373-47f9-82d3-c62ae2736c5b admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:44:19.805782 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:44:19.805782 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: warnings.warn(msg) Jun 20 18:44:19.807181 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-492f64a2-3373-47f9-82d3-c62ae2736c5b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:44:19.807627 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-492f64a2-3373-47f9-82d3-c62ae2736c5b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:44:19.809054 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-492f64a2-3373-47f9-82d3-c62ae2736c5b admin admin] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:44:19.809484 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-492f64a2-3373-47f9-82d3-c62ae2736c5b admin admin] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:44:19.830720 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-492f64a2-3373-47f9-82d3-c62ae2736c5b admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077273 Jun 20 18:44:19.831224 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 39/76] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Jun 20 18:44:19 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:45:13.938091 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: Mon Jun 20 18:45:13 2022 - graceful shutdown triggered... Jun 20 18:45:13.938333 dv-cinder-836973-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 20 18:45:13.939061 dv-cinder-836973-6-iscsi devstack@n-api.service[109827]: Gracefully killing worker 2 (pid: 109827)... Jun 20 18:45:13.939426 dv-cinder-836973-6-iscsi devstack@n-api.service[109826]: Gracefully killing worker 1 (pid: 109826)... Jun 20 18:45:14.939225 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: worker 1 buried after 1 seconds Jun 20 18:45:14.939663 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: worker 2 buried after 1 seconds Jun 20 18:45:14.939663 dv-cinder-836973-6-iscsi devstack@n-api.service[109825]: goodbye to uWSGI. Jun 20 18:45:14.940814 dv-cinder-836973-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 20 18:45:14.941872 dv-cinder-836973-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 20 18:45:14.944811 dv-cinder-836973-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 18:45:14.960429 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 18:45:14.962421 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 18:45:14 2022] *** Jun 20 18:45:14.962421 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 18:45:14.962421 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 18:45:14.962421 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: nodename: dv-cinder-836973-6-iscsi Jun 20 18:45:14.962421 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: machine: x86_64 Jun 20 18:45:14.962421 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: clock source: unix Jun 20 18:45:14.962421 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: pcre jit disabled Jun 20 18:45:14.962421 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: detected number of CPU cores: 4 Jun 20 18:45:14.962421 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: current working directory: / Jun 20 18:45:14.962421 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: detected binary path: /usr/bin/uwsgi-core Jun 20 18:45:14.963186 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: your processes number limit is 47680 Jun 20 18:45:14.963186 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: your memory page size is 4096 bytes Jun 20 18:45:14.963186 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: detected max file descriptor number: 2048 Jun 20 18:45:14.963186 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: lock engine: pthread robust mutexes Jun 20 18:45:14.963186 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: thunder lock: enabled Jun 20 18:45:14.963186 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 18:45:14.963186 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 18:45:15.006847 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: Python main interpreter initialized at 0x560fc61cb9c0 Jun 20 18:45:15.006847 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: python threads support enabled Jun 20 18:45:15.006847 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: your server socket listen backlog is limited to 100 connections Jun 20 18:45:15.006847 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: your mercy for graceful operations on workers is 90 seconds Jun 20 18:45:15.007351 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 18:45:15.007351 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: *** Operational MODE: preforking *** Jun 20 18:45:15.007634 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: *** uWSGI is running in multiple interpreter mode *** Jun 20 18:45:15.007634 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: spawned uWSGI master process (pid: 124174) Jun 20 18:45:15.007839 dv-cinder-836973-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 18:45:15.008521 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: spawned uWSGI worker 1 (pid: 124189, cores: 1) Jun 20 18:45:15.014269 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: spawned uWSGI worker 2 (pid: 124190, cores: 1) Jun 20 18:45:15.014269 dv-cinder-836973-6-iscsi devstack@n-api.service[124174]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 18:45:15.665044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 18:45:15.672250 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 18:45:16.849931 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 18:45:16.849931 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: from cryptography.utils import int_from_bytes Jun 20 18:45:16.850561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 18:45:16.850561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: from cryptography.utils import int_from_bytes Jun 20 18:45:16.868405 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 18:45:16.868405 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: from cryptography.utils import int_from_bytes Jun 20 18:45:16.868953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 18:45:16.868953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: from cryptography.utils import int_from_bytes Jun 20 18:45:19.206053 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 18:45:19.206667 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 18:45:19.207427 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 18:45:19.207793 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 18:45:19.208050 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 18:45:19.208440 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.208763 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.209079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.209392 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.209717 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.210023 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.210340 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.210652 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.210998 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.211260 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.211567 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.211886 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-6-iscsi {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.212202 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.212508 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.212812 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.213122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.213424 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.213744 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.214046 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.214545 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.215027 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.215333 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.215638 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.216025 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.216290 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.216581 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.216897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.217201 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.217522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.217827 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.218228 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-6-iscsi {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.218559 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.218849 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.219185 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.219600 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.219922 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.220214 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.220526 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.220859 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.221165 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.221487 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.221801 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.222113 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.223012 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.223315 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.223627 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.223934 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.224247 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.224548 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.224847 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.225094 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.225397 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.225714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.226028 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.226347 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.226595 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.226841 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.227343 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.227660 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.227965 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.228437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.228750 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.229055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.229358 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.229662 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.229969 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.230269 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.230583 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.230894 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.231236 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.231545 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.231859 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.232254 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.232507 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.232747 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 18:45:19.233203 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.233291 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 18:45:19.233371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.233452 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.233533 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 18:45:19.233738 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.233855 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 18:45:19.234051 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.234152 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 18:45:19.234370 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.234463 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.234676 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.234767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.235071 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.235182 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.235379 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.235479 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.235699 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.235826 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.236034 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.236151 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.236334 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.236443 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.236578 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.236669 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.236875 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.237011 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.237177 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.237273 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.237488 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.237597 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.237791 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.238099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-6-iscsi {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.238780 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.238879 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.238999 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.239087 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.239280 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.239401 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.239585 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.239686 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.239880 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.239979 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.240180 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.240271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.240477 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.240641 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.240771 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.240975 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.241149 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.241288 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.241430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.241568 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.241773 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.241931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.242086 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.242239 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.242405 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.242558 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.242705 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.242855 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.243065 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.243178 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.243284 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.243370 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.243466 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.243678 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.243792 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.243978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.244193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.244368 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-6-iscsi {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.244500 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.244676 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.244806 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.244980 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.245125 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.245283 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.245429 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.245686 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.245801 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.245994 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.246091 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.246296 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.246396 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.246610 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.246727 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.246938 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.247060 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.247238 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.247338 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.247540 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.247651 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.247853 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.247957 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.248157 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.248250 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.248459 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.248566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.248750 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.248897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.249052 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.249151 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.249352 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.249469 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.249647 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.249764 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.249947 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.250048 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.250244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.250346 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.250537 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.250629 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.250852 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.251004 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.251197 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.251518 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.251637 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.251723 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.251815 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.252031 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.252145 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.252219 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.252384 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.252476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.252719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.252810 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.253032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.253114 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.253337 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.253417 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.253667 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.253773 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.253967 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.254056 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.254268 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.254359 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.254569 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.254660 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.254871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.255003 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.255197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.255286 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.259140 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.259320 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.259502 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.259748 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.259905 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.260067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.260229 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.260384 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.260538 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.260684 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.260835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.260994 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.261148 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.261293 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.261447 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.261604 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.261750 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.261908 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.262060 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.262206 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.262350 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.262495 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.262646 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.262806 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.263001 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.263159 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.263312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.263465 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.263634 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.263795 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.263948 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.264093 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.264252 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.264397 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.264556 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.264703 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.264855 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.265006 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.265157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.265309 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.265463 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.265627 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.265773 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.266017 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.266177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.266323 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.266482 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.266628 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.266796 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.267119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.267279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.267517 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.267697 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.267929 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.268090 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.268245 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.268398 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.268550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.268709 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.268709 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.269012 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.269237 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.269388 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.269542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.269696 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.269944 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.270115 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.270271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.270416 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.270628 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.270784 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.271048 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.271214 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.271371 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.271524 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.271680 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.271834 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.271981 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.272125 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.272289 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.272435 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.272589 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.272735 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.272890 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.273045 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.273045 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.273340 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.273493 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.273639 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.273784 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.273938 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.274093 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.274257 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.274411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.274563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.274708 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.274853 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.275035 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.275192 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.275338 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.275483 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.275627 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.275779 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.275932 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.276165 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.276328 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.276482 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.276627 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.276781 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.276934 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.277099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.277320 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.277487 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.277711 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.277877 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.278125 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.278276 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.278434 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.278767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.278963 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.279141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.279141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.279524 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.279679 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.279833 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.280080 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.280242 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.280397 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.280544 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.280689 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.280846 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.281001 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.281147 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.281292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.281445 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.281591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.281736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.281890 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.282044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.282198 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:45:19.282391 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.282555 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.282702 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.282884 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.283055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.283258 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.283409 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.283555 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.283717 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.283870 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.284025 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.284179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.284325 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.284477 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.284632 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.285275 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.285433 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.285591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.285738 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.285882 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.286042 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.286207 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.286691 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.286842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.287023 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.287023 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.287332 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.287552 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.287733 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.287974 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.288144 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.288389 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.288554 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.288717 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.288885 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.289043 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.289190 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.289363 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.289580 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.289733 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.289889 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.290066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.290286 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.290447 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.290602 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.290756 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.290943 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.291100 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.291246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.291404 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.291550 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.291708 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.291856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.292023 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.292187 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.292340 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.292492 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.292637 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.292788 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.292938 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.293097 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.293243 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.293388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.293532 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.293676 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.293827 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.293997 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.294144 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.294297 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.294450 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.294609 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.294761 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.294936 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.295099 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.295244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.295396 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.295549 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.295703 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.295848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.296011 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.296158 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.296302 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.296446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.296599 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.296837 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.296997 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.297152 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.297305 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.297457 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.297700 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.297859 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.298095 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.298267 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.298508 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.298674 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.298904 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.299076 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.299223 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.299368 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.299523 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.299757 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.299922 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.300077 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.300224 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.300499 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.301174 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.301333 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.301486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.301632 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.301783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.301936 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.302081 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.302234 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.302381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.302533 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.302686 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.302838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.303005 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.303175 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.303322 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.303468 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.303613 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.303773 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.303919 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.304078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.304230 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.304382 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.304539 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.304692 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.304850 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.305014 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.305167 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.305313 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.305466 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.305619 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.305773 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.305927 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.306086 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.306239 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.306391 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.306538 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.306692 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.306861 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.307147 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.307307 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.307454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.307600 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.307966 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.308242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.308415 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.308651 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.308812 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.308974 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.309122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.309268 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.309422 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.309581 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.309755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.309988 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.310316 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.310490 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.310723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.310723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.311035 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.311200 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.311348 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.311492 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.311636 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.311782 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.311938 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.312099 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.312252 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.312398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.312550 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.312703 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.312867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.313017 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.313162 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.313315 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.313469 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.313623 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.313788 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.313943 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.314089 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.314234 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.314387 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.314532 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.314691 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.314691 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.314998 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.315160 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.315306 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.315458 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.315618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.315773 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.315926 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.316099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.316250 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.316413 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.316560 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.316705 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.316858 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.317004 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.317246 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.317414 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.317567 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.317721 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.317877 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.318121 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.318361 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.318522 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.318693 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.318693 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.319125 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.319273 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.319418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.319616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.319772 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.319925 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.320163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.320330 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.320487 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.320642 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.320885 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.321038 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.321192 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.321338 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.321493 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.321646 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.321799 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.321944 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.322089 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.322246 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.322406 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.322406 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.322682 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.322845 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.323027 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.323182 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.323343 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.323497 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.323642 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.323795 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.323948 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.324108 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.324264 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.324421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.324592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.324759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.324909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.325062 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.325207 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.325352 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.325507 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.325661 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.325805 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.325957 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.326110 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.326264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.326416 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.326572 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.326717 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.326861 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.327082 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.327248 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.327481 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.327641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.327787 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.327932 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.328105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.328340 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.328651 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.328805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.329047 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.329200 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.329354 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.329500 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.329656 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.329801 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.329954 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.330099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.330338 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.330498 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.330656 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.330825 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.331107 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.331258 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.331410 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.331564 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.331753 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.331902 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.332046 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.332191 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.332336 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.332490 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.332643 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.332813 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.332965 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.333119 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.333265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.333420 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.333566 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.333726 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.333873 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.334017 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.334169 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.334323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.334468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.334636 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.334801 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.335002 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.335167 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.335313 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.335464 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.335609 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.335761 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.335909 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.336063 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.336208 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.336365 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.336518 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.336664 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.336834 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.336991 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.337138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.337289 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.337460 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.337679 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.337843 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.337998 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.338144 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.338316 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.338561 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.338781 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.338962 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.339240 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.339400 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.339555 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.339708 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.339861 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.340016 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.340164 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.340330 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.340558 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.340709 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.340864 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.341021 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.341385 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.341544 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.341699 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.341852 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.342020 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.342175 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.342322 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.342473 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.342626 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.342772 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.342974 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.343128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.343274 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.343440 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.344313 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.344476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.344641 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.344798 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.344952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.345097 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.345243 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.345400 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.345556 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.345701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.345853 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.345999 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.346158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.346312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.346460 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.346605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.346757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.346903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.347089 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.347245 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.348013 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.348165 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.348311 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.348457 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.348701 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.348969 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.349123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.349369 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.349540 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.349796 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.349972 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.350135 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.350281 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.350281 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.350592 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.350828 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.351035 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.351207 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.351457 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.351620 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.351781 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.351929 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.352083 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.352239 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.352391 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.352542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.352694 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.352853 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.353013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.353164 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.353164 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.353484 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.353635 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.353800 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.353952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.354103 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.354254 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.354454 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.354616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.354770 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.354770 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.355093 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.355256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.355430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.355591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.355744 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.355909 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.356062 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.356213 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.356379 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.356532 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.356683 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.356841 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.357001 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.357160 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.357322 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.357493 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.357645 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.357796 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.357956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.358215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.358373 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.358525 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.358704 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.359075 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.359261 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.359541 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.359707 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.359869 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.360034 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.360194 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.360354 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.360519 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.360678 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.360857 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.361102 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.361263 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.361640 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.361813 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.361969 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.362121 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.362287 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.362447 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.362678 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.362834 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.363583 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.363754 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.363907 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.364058 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.364223 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.364376 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.364534 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.364686 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.364845 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.365010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.365176 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.365330 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.365494 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.365647 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.365805 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.365963 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.366123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.366283 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.366436 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.366594 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.366745 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.366903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.367120 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.367274 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.367440 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.367602 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.367754 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.367913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.368073 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.368243 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.368470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.368626 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.368777 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.368962 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.369271 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.369432 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.369683 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.369843 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.370003 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.370165 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.370325 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.370486 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.370639 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.370790 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.371038 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.371257 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.371416 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.371748 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.371919 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.372073 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.372235 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.372396 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.372556 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.372708 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.372866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.373026 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.373192 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.373352 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.373504 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.373674 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.373674 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.373974 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.374141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.374300 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.374459 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.374612 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.374612 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.374945 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.375115 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.375267 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.375426 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.375586 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.375747 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.375747 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.375747 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.376210 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.376362 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.376512 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.376670 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.376837 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.376997 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.377149 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.377300 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.377451 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.378154 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.378312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.378492 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.378936 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.379122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.379486 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.380216 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.380387 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.380387 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.380688 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.380850 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.381004 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.381166 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.381327 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.381489 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.381642 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.382078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.382257 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.382495 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.382665 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.382818 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.383040 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.383275 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.383445 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.383640 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.383816 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.383970 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.384130 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.384295 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.384448 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.384645 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.384811 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.384963 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.385128 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.385281 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.385432 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.385582 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.385809 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.386020 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.386182 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.386305 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.386489 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.386644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.386796 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.386992 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.387162 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.387325 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.387477 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.387638 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.387836 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.388006 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.388168 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.388330 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.388482 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.388634 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.388826 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.389154 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.389325 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.389669 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.389828 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.390038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.390220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.390481 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.390655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.390809 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.391023 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.391183 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.391337 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.391505 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.391658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.391859 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.392260 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.392423 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.392585 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.392747 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.392899 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.393071 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.393224 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.393376 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.393540 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.393716 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.393865 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.394023 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.394174 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.394363 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.394588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.394782 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.394970 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.395143 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.395310 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.395462 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.395624 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.395778 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.395936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.396096 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.396251 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.396486 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.396667 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.396823 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.396983 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.397136 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.397288 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.397452 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.397624 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.397624 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.397939 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.398207 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.398435 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.398435 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.398435 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.399027 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.399338 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.399501 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.399501 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.399501 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.400207 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.400402 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.400769 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.400949 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.401104 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.401281 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.401491 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.401698 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.401935 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.402165 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.402511 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.402671 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.402843 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.403166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.403166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.403166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.403166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.403166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.403883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.404036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.404036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.404394 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.404547 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.404699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.404850 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.405021 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.405192 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.405354 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.405506 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.405705 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.405866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.406096 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.406361 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.406361 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.406673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.406834 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.407008 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.407191 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.407360 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.407513 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.407513 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.407880 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.408041 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.408282 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.408462 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.408739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.408980 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.409141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.409325 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.409577 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.410477 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.410650 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.410906 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.411099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.411521 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.411713 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.411876 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.411876 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.412197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.412607 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.412776 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.412953 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.413120 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.413308 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.413474 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.413627 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.413627 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.413969 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.414137 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.414300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.414453 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.414605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.414605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.414980 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.415153 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.415307 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.415307 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.415307 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.415766 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.415925 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.416077 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.416244 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.416244 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.416581 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.416748 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.416901 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.416901 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.416901 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.416901 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.417481 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.417481 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.417481 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.417481 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.417481 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.417481 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.417481 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.417481 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.418787 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.418787 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.419110 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.419274 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.419446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.419696 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.419879 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.420106 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.420106 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.420411 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.420691 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.420691 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.421026 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.421128 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.421222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.421323 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.421418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.421589 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.421589 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.421589 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.422079 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.422251 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.422412 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.422564 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.422893 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.423096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.423264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.423424 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.423589 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.423741 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.423899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.423899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.424218 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.424380 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.424533 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.424721 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.424885 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.425039 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.425199 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.425352 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.426103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.426273 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.426427 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.426578 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.426738 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.426890 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.427066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.427219 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.427370 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.427533 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.427696 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.427696 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.427985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.428157 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.428310 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.428470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.428622 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.428810 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.428968 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.429119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.429278 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.429443 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.429603 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.429852 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.430025 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.430272 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.430461 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.430688 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.430938 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.431101 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.431254 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.431417 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.431579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.431731 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.431882 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.432041 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.432193 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.432353 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.432515 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.432680 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.432998 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.433169 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.433324 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.433487 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.433648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.433648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.433946 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.434112 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.434304 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.434467 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.434620 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.434783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.435000 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.435160 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.435323 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.435485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.435639 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.435790 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.435942 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.436160 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.436318 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.436479 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.436632 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.436791 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.436988 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.437148 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.437308 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.437470 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.437631 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.437790 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.437949 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.437949 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.437949 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.437949 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.437949 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.438749 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.438976 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.439148 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.439317 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.439478 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.439630 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.439783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.440032 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.440192 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.440444 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.440605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.440759 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.440939 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.441202 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.441377 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.441558 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.441720 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.441881 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.442033 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.442184 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.442184 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.442577 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.442750 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.442941 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.443422 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.443622 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.443622 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.444034 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.444212 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.444468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.444644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.444799 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.445015 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.445175 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.445342 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.445542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.445698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.445857 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.446061 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.446228 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.446392 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.446551 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.446704 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.446855 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.447182 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.447352 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.447515 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.447703 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.447859 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.448025 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.448219 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.448219 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.448522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.448686 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.448838 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.449000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.449153 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.449153 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.449447 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.449778 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.449937 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.450229 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.450416 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.450643 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.450800 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.450983 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.451141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.451406 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.451573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.451726 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.451913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.452078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.452245 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.452432 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.452591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.452743 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.452893 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.453044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.453377 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.453541 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.453694 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.453853 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.454048 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.454210 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.454418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.454583 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.454743 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.454903 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.455103 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.455266 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.455438 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.455598 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.455758 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.455918 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.456070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.456231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.456384 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.456581 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.456775 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.456775 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.457080 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.457080 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.457381 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.457534 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.457693 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.457845 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.458011 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.458201 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.458353 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.458510 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.458672 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.458824 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.459008 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.459173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.459326 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.459499 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.459659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.459821 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.459983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.460136 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.460379 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.460536 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.460804 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.460804 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.461124 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.461284 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.461534 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.461534 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.461854 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.462016 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.462203 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.462367 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.462519 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.462678 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.462849 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.463071 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.463071 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.463520 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.463681 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.463848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.464015 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.464175 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.464331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.464483 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.464677 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.464836 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.464998 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.465157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.465310 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.465469 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.465621 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.465621 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.465930 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.465930 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.466262 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.466418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.466576 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.466737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.466890 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.467078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.467238 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.467390 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.467541 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.467701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.467864 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.468024 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.468175 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.468334 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.468485 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.468644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.468831 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.468987 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.469147 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.469147 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.469444 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.469598 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.469748 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.469909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.470060 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.470219 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.470428 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.470654 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.470896 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.471092 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.471256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.471409 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.471409 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.471807 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.471967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.472127 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.472850 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.473032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.473199 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.473352 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.473652 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.473825 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.473978 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.474139 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.474306 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.474460 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.474611 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.474773 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.474954 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.475142 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.475297 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.475448 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.475607 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.475760 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.475917 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.476078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.476238 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.476992 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.477162 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.477323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.477488 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.477657 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.477817 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.477984 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.477984 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.478281 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.478473 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.478994 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.479191 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.479434 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.479592 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.479744 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.479915 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.480076 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.480238 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.480405 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.480566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.480837 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.481122 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.481277 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.481445 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.481599 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.481871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.482031 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.482184 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.482355 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.482520 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.482675 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.482826 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.483021 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.483181 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.483333 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.483501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.483837 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.483999 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.484153 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.484313 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.484475 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.484661 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.484840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.484998 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.485171 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.485335 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.485515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.485670 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.485844 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.486001 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.486160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.486313 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.486520 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.486692 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.486852 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.486852 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.487184 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.487345 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.487508 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.487668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.487822 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.488045 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.488201 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.488368 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.488531 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.488691 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.488866 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.489063 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.489222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.489388 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.489549 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.489717 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.489871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.489871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.490410 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.490523 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.490620 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.490707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.490815 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.490906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.491263 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.491412 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.492257 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 18:45:19.492418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.492418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.492418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.492418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.492418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.492418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.492418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.492418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.493425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.493425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.493425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.493425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.493425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.493425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.493425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.493425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.494643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.494643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.494643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.494643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.494643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.494643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.494643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.494643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.495663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.495663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.495663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.495663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.495663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.495663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.495663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.495663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.496649 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.496649 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.496649 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.496649 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.496649 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.496649 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.496649 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.496649 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.497648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.497648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.497648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.497648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.497648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.497648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.497648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.497648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.498605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.498605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.498605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.498605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.498605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.498605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.498605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.498605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.499664 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.499664 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.499664 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.499664 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.499664 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.499664 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.499664 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.499664 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.500641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.500641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.500641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.500641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.500641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.500641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.500641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.500641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.501797 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.501797 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.501797 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.501797 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.501797 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.501797 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.501797 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.501797 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.502906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.502906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.502906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.502906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.502906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.502906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.502906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.502906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.504566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.504566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.504566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.504566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.504566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.504566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.504566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.504566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.505591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.505591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.505591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.505591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.505591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.505591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.505591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.505591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.506570 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.506570 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.506570 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.506570 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:45:19.506570 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 18:45:19.531922 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO dbcounter [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] Registered counter for database nova_api Jun 20 18:45:19.552683 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_db.sqlalchemy.engines [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:45:19.559138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writer thread running {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:45:19.568959 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO dbcounter [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] Registered counter for database nova_api Jun 20 18:45:19.588831 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_db.sqlalchemy.engines [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:45:19.595337 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writer thread running {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:45:19.615472 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.context [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb(cell1) {{(pid=124190) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 18:45:19.619569 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:45:19.621142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:45:19.621935 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:45:19.623896 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:45:19.625873 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO dbcounter [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] Registered counter for database nova_cell0 Jun 20 18:45:19.630457 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO dbcounter [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] Registered counter for database nova_cell1 Jun 20 18:45:19.637689 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_db.sqlalchemy.engines [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:45:19.639446 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_db.sqlalchemy.engines [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:45:19.645788 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writer thread running {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:45:19.647614 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writer thread running {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:45:19.651942 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.context [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb(cell1) {{(pid=124189) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 18:45:19.656029 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:45:19.657610 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:45:19.658404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:45:19.660383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:45:19.662647 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO dbcounter [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] Registered counter for database nova_cell0 Jun 20 18:45:19.666682 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO dbcounter [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] Registered counter for database nova_cell1 Jun 20 18:45:19.674638 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_db.sqlalchemy.engines [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:45:19.676007 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_db.sqlalchemy.engines [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:45:19.683866 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writer thread running {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:45:19.684202 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writer thread running {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:45:19.796611 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO dbcounter [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] Registered counter for database nova_cell0 Jun 20 18:45:19.803920 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_db.sqlalchemy.engines [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:45:19.808248 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writer thread running {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:45:19.832536 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO dbcounter [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] Registered counter for database nova_cell0 Jun 20 18:45:19.839141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_db.sqlalchemy.engines [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:45:19.843426 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writer thread running {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:45:20.123655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: WARNING keystonemiddleware.auth_token [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 18:45:20.130884 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: WARNING keystonemiddleware.auth_token [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 18:45:20.161204 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: WARNING keystonemiddleware.auth_token [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 18:45:20.168751 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: WARNING keystonemiddleware.auth_token [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 18:45:20.479447 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: WARNING keystonemiddleware.auth_token [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 18:45:20.485400 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: WARNING keystonemiddleware.auth_token [None req-fe881a26-6fa7-4152-bdaa-32d59a4f26b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 18:45:20.491335 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560fc61cb9c0 pid: 124190 (default app) Jun 20 18:45:20.512913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: WARNING keystonemiddleware.auth_token [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 18:45:20.518834 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: WARNING keystonemiddleware.auth_token [None req-db5b6751-4099-4f87-b30f-d8e3c45a0c14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 18:45:20.524356 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560fc61cb9c0 pid: 124189 (default app) Jun 20 18:46:00.575381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=3 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:00.580194 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=3 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:00.582630 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=3 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:00.583768 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=3 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:02.474809 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-37b6859b-4cde-4543-9a10-19fe840c47bc tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Action: 'create', calling method: .version_select at 0x7f7e4691e790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1457311465"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:46:04.368950 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-37b6859b-4cde-4543-9a10-19fe840c47bc tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.807819 Jun 20 18:46:04.371004 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1154 bytes} [Mon Jun 20 18:46:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3812 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 18:46:05.108718 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4e2d674d-8eaa-4b2c-8670-fd90ecc49bd1 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e469d2310>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:05.167086 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=3 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:05.172571 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=3 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:05.173890 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=3 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:05.175085 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=3 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:06.906109 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4e2d674d-8eaa-4b2c-8670-fd90ecc49bd1 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5" status: 200 len: 346 microversion: 2.1 time: 2.525938 Jun 20 18:46:06.912229 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 1/2] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:46:04 2022] GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5 => generated 346 bytes in 2534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:46:06.930905 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4236bfc1-d686-4fa0-a8b8-35d7a8233f9d tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Action: 'create', calling method: .version_select at 0x7f7e467e7550>, body: {"snapshot": {"volume_id": "354cd26f-e405-4a41-b6e7-5de9798d64c5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-723274234"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:46:07.392109 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4236bfc1-d686-4fa0-a8b8-35d7a8233f9d tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.471675 Jun 20 18:46:07.393690 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 2/3] 10.222.0.43 () {60 vars in 1161 bytes} [Mon Jun 20 18:46:06 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:07.406208 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-bc955273-fb36-43ad-8cbb-edac47fb09f5 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e468265e0>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:07.494511 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-bc955273-fb36-43ad-8cbb-edac47fb09f5 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef" status: 200 len: 286 microversion: 2.1 time: 0.093435 Jun 20 18:46:07.495688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jun 20 18:46:07 2022] GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:07.508363 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9d62c2cf-a6ee-4c36-a2d2-be672775c14c tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e467e75e0>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:07.598741 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9d62c2cf-a6ee-4c36-a2d2-be672775c14c tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.096012 Jun 20 18:46:07.600501 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 3/5] 10.222.0.43 () {58 vars in 1139 bytes} [Mon Jun 20 18:46:07 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:07.612478 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c96c5875-1138-41ae-bc58-c19e72411e9e tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e46826550>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:07.664449 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c96c5875-1138-41ae-bc58-c19e72411e9e tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef" status: 200 len: 286 microversion: 2.1 time: 0.057103 Jun 20 18:46:07.669580 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 3/6] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jun 20 18:46:07 2022] GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:08.680559 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-80e17530-253d-43c5-99f2-0702ae550865 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e46780310>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:08.794111 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-80e17530-253d-43c5-99f2-0702ae550865 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef" status: 200 len: 286 microversion: 2.1 time: 0.122428 Jun 20 18:46:08.795081 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jun 20 18:46:08 2022] GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef => generated 286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:09.807043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-64d60778-e2b7-40a8-9da2-f1314dfa2d2c tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e46826dc0>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:09.848524 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-64d60778-e2b7-40a8-9da2-f1314dfa2d2c tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef" status: 200 len: 286 microversion: 2.1 time: 0.045226 Jun 20 18:46:09.849089 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jun 20 18:46:09 2022] GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:10.860562 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9518f0e0-a2ac-41f9-ac56-a19dd155d8e2 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e467e84c0>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:10.941161 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9518f0e0-a2ac-41f9-ac56-a19dd155d8e2 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef" status: 200 len: 286 microversion: 2.1 time: 0.084228 Jun 20 18:46:10.946399 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 5/9] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jun 20 18:46:10 2022] GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:46:11.500384 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9122c410-0296-4537-af54-69de48d422ac tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Action: 'create', calling method: .version_select at 0x7f7e46780790>, body: {"keypair": {"name": "tempest-keypair-415244161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAKFvyBPsLgwE+GuBS0nbPeWBdyxdguxVRx5QtbqV3eaVF51q3+1IUfn9Ct1+B7aRR5h6w5TvDpKSfFJy1FC8WFKCnry225Pj6nUywcmQaUjq6BCnOMkWBuQA67dPuISw=="}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:46:11.620599 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-9122c410-0296-4537-af54-69de48d422ac tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Getting quotas for project e724578c7aab45bb8ae2317c33e3be33. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:46:11.625097 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-9122c410-0296-4537-af54-69de48d422ac tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Getting quotas for user 016cfd43630b42f38efcd37ea9a66a10 and project e724578c7aab45bb8ae2317c33e3be33. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:46:11.735447 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9122c410-0296-4537-af54-69de48d422ac tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.905009 Jun 20 18:46:11.739912 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 5/10] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jun 20 18:46:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:11.953600 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c245232e-669b-4a16-a935-003d82c61a7f tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e46826ca0>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:12.017308 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c245232e-669b-4a16-a935-003d82c61a7f tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef" status: 200 len: 286 microversion: 2.1 time: 0.067780 Jun 20 18:46:12.022901 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 6/11] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jun 20 18:46:11 2022] GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:12.859031 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ab316dd5-20a3-41ae-8b6a-a28442f6085a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Action: 'create', calling method: .version_select at 0x7f7e4675a280>, body: {"keypair": {"name": "tempest-keypair-1475521525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoTkh1aq4OWPkOJ1SF0AyBbiO7ZY2Y0O1pKOdd3Iaphuxoli7oLctIcnv/skwmGIZKD9tIvxys2v4CmQGBxZljzMqNKi3u0iqjMliJhref9/bO9Fp4BEi2elTfww29dFQ=="}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:46:12.901783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-ab316dd5-20a3-41ae-8b6a-a28442f6085a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Getting quotas for project b4944c36091d4f5f84e06386ee5a1589. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:46:12.909188 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-ab316dd5-20a3-41ae-8b6a-a28442f6085a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Getting quotas for user 60a36e18710443359ba2a56ad2810043 and project b4944c36091d4f5f84e06386ee5a1589. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:46:12.946702 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ab316dd5-20a3-41ae-8b6a-a28442f6085a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.428634 Jun 20 18:46:12.948986 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 6/12] 10.222.0.43 () {62 vars in 1199 bytes} [Mon Jun 20 18:46:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 432 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 18:46:13.030549 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-2432238e-4e9f-49e4-a48c-84a340858f1d tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e46826790>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:13.113843 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-2432238e-4e9f-49e4-a48c-84a340858f1d tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef" status: 200 len: 286 microversion: 2.1 time: 0.087098 Jun 20 18:46:13.114663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jun 20 18:46:13 2022] GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:14.125745 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d0def841-6344-4ddd-ace4-111c33578405 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e45f0cf70>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:14.201185 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d0def841-6344-4ddd-ace4-111c33578405 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef" status: 200 len: 287 microversion: 2.1 time: 0.079162 Jun 20 18:46:14.201752 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 7/14] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jun 20 18:46:14 2022] GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:14.214028 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f04582cc-b20b-4314-af87-ec64e290f395 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e467e8670>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:14.350293 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f04582cc-b20b-4314-af87-ec64e290f395 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef" status: 202 len: 0 microversion: 2.1 time: 0.141243 Jun 20 18:46:14.350867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 8/15] 10.222.0.43 () {58 vars in 1253 bytes} [Mon Jun 20 18:46:14 2022] DELETE /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:46:14.359685 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ba6f2e07-e1c3-499f-970d-97dac0571aa3 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e45f0cc10>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:14.441476 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ba6f2e07-e1c3-499f-970d-97dac0571aa3 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef" status: 200 len: 286 microversion: 2.1 time: 0.086280 Jun 20 18:46:14.442233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jun 20 18:46:14 2022] GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:15.456507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-852e09f9-82e8-4175-a4af-c4b2f4c44d9e tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e46826550>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:15.517402 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-852e09f9-82e8-4175-a4af-c4b2f4c44d9e tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef" status: 200 len: 286 microversion: 2.1 time: 0.067646 Jun 20 18:46:15.518659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 9/17] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jun 20 18:46:15 2022] GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:16.529897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2f6ee40a-bac2-49e2-8b90-872e28c7467c tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e471498b0>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:16.610538 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2f6ee40a-bac2-49e2-8b90-872e28c7467c tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef" status: 200 len: 286 microversion: 2.1 time: 0.084315 Jun 20 18:46:16.611790 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 9/18] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jun 20 18:46:16 2022] GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:17.623747 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b4729bf9-97c1-4c07-b7da-a3015e681e63 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e46826d30>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:17.681721 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b4729bf9-97c1-4c07-b7da-a3015e681e63 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef" status: 200 len: 286 microversion: 2.1 time: 0.063782 Jun 20 18:46:17.683320 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 10/19] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jun 20 18:46:17 2022] GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:17.856608 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-188836834", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1789880-f2ae-400c-beb2-23e8cf0eb58d"}], "security_groups": [{"name": "tempest-securitygroup--758069642"}], "key_name": "tempest-keypair-415244161", "user_data": "}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:46:18.636730 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.network.neutron [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] validate_networks() for [('c1789880-f2ae-400c-beb2-23e8cf0eb58d', None, None, None, None, None)] {{(pid=124190) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:46:18.698560 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3071d966-a75d-4826-b013-732a0356e8a7 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e467e81f0>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:18.806868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-3071d966-a75d-4826-b013-732a0356e8a7 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] HTTP exception thrown: Snapshot 52116f35-495f-4074-9dec-540c971a55ef could not be found. Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3071d966-a75d-4826-b013-732a0356e8a7 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Request method failure captured: Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef HTTP/1.1 Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMBonJuNbKcOTJ844PL_Yva8v8BI0Okr8rmHWyt88XPTp0J6yv6YfRwkXzzkrmtexKw1K2NPPnDSZZAPe3tVjSepINbPHVGSTc_yHpQXZhtwICMmWEhT7kbcDJIwhxp4y1_VYdD_la_HkmloUgEfysAlh0o2l9CSpSlLl-IPv97Kf_A Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 28aec5b111624af3a061ce7fd1a03b32 Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-905105355 Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:46:18.813908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:46:18.815404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_28aec5b111624af3a061ce7fd1a03b32", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/28aec5b111624af3a061ce7fd1a03b32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/28aec5b111624af3a061ce7fd1a03b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/28aec5b111624af3a061ce7fd1a03b32"}]}] Jun 20 18:46:18.815404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-VolumesSnapshotsTestJSON-905105355 Jun 20 18:46:18.815404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 28aec5b111624af3a061ce7fd1a03b32 Jun 20 18:46:18.815404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-905105355 Jun 20 18:46:18.815404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-VolumesSnapshotsTestJSON-905105355-project Jun 20 18:46:18.815404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:46:18.815404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:46:18.815404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: e13f3c0f9456465d8c9ceb206f958373 Jun 20 18:46:18.815404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-VolumesSnapshotsTestJSON-905105355-project Jun 20 18:46:18.815404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: Jun 20 18:46:18.815404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Snapshot 52116f35-495f-4074-9dec-540c971a55ef could not be found. Jun 20 18:46:18.815404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '52116f35-495f-4074-9dec-540c971a55ef'} Jun 20 18:46:18.815404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 52116f35-495f-4074-9dec-540c971a55ef could not be found. (HTTP 404) (Request-ID: req-443f916e-1af5-4403-aa28-41c1aa893da0) Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:46:18.816059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 18:46:18.816913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 52116f35-495f-4074-9dec-540c971a55ef could not be found. Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 20 18:46:18.819579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:46:18.823688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 52116f35-495f-4074-9dec-540c971a55ef could not be found. Jun 20 18:46:18.823688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:46:18.823688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:46:18.823688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:46:18.823688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:18.823688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:46:18.823688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:46:18.823688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:46:18.823688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:46:18.823688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 52116f35-495f-4074-9dec-540c971a55ef could not be found. Jun 20 18:46:18.823688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:46:18.823688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3071d966-a75d-4826-b013-732a0356e8a7 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Returning 404 to user: Snapshot 52116f35-495f-4074-9dec-540c971a55ef could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:46:18.823688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-3071d966-a75d-4826-b013-732a0356e8a7 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef" status: 404 len: 111 microversion: 2.1 time: 0.124466 Jun 20 18:46:18.823688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 11/20] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jun 20 18:46:18 2022] GET /compute/v2.1/os-snapshots/52116f35-495f-4074-9dec-540c971a55ef => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:46:19.534815 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1219300314", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "networks": [{"uuid": "7cb97bf3-c2aa-41a4-b4aa-ac1cf827e022"}]}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:46:19.688928 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.network.neutron [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] validate_networks() for [('7cb97bf3-c2aa-41a4-b4aa-ac1cf827e022', None, None, None, None, None)] {{(pid=124189) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:46:20.679851 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Flavor limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:46:20.681321 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Image limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:46:20.681951 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Flavor pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:46:20.682506 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Image pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:46:20.683521 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:46:20.703320 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:20.703793 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:20.709311 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:20.709768 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:20.777595 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Getting quotas for project e724578c7aab45bb8ae2317c33e3be33. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:46:20.786591 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Getting quotas for user 016cfd43630b42f38efcd37ea9a66a10 and project e724578c7aab45bb8ae2317c33e3be33. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:46:20.811552 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Going to run 1 instances... {{(pid=124190) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:46:20.820037 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124190) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:46:20.941345 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1e64ab42-f8ca-4d07-849d-7f81cf0c224d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.091569 Jun 20 18:46:20.942251 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 10/21] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:46:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 3094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:46:20.953769 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1a72f31f-4b41-4295-825a-9de758fbedde tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e45eafb80>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:21.127397 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1a72f31f-4b41-4295-825a-9de758fbedde tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5" status: 202 len: 0 microversion: 2.1 time: 0.183479 Jun 20 18:46:21.128229 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 11/22] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jun 20 18:46:20 2022] DELETE /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:46:21.179992 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Flavor limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:46:21.180484 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Image limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:46:21.181124 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Flavor pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:46:21.181782 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Image pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:46:21.182766 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:46:21.207164 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:21.207792 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:21.208731 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:21.209446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:21.251141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Getting quotas for project 21f1a2549de24c31910eb3cdb809c5e9. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:46:21.260531 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Getting quotas for user 2ada4576c0084912b41c846d849ce6ee and project 21f1a2549de24c31910eb3cdb809c5e9. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:46:21.291154 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Going to run 1 instances... {{(pid=124189) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:46:21.300053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124189) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:46:21.513515 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-89c6f895-88b8-438f-9eef-4ffcaa7b9576 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.687319 Jun 20 18:46:21.515300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 12/23] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:46:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:46:21.526463 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1999437526", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cac90707-8479-4653-a9fa-f25caced7385"}], "security_groups": [{"name": "tempest-securitygroup--710273890"}], "key_name": "tempest-keypair-1475521525", "user_data": "}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:46:21.676357 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-3ea5293a-b8b2-4f25-94bc-a2970a7c7550 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Action: 'create', calling method: .version_select at 0x7f7e45eaf700>, body: {"keypair": {"name": "tempest-keypair-595114772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/NqcRKyiqA7UmrWE2NdJYipq3FXDSxcWRhnqnzAWycmlLHC/JKHpITovHpz+8yWMUjyPS4ItRXrXPvKX+Gc75ZmpVk+vBS48rZ5D9nlxgSbQOL9yFSylKIL8JQa9W8Cw=="}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:46:21.729289 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-3ea5293a-b8b2-4f25-94bc-a2970a7c7550 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for project 8006d78bc1604611b3254b5efa451288. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:46:21.739408 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-3ea5293a-b8b2-4f25-94bc-a2970a7c7550 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for user c3134832f2a647aab761da347f7e9fd4 and project 8006d78bc1604611b3254b5efa451288. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:46:21.775230 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-3ea5293a-b8b2-4f25-94bc-a2970a7c7550 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.645795 Jun 20 18:46:21.776621 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 12/24] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jun 20 18:46:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:21.797801 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f8aff52f-1a42-43b9-95a6-cfc533646eaa tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:21.798425 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f8aff52f-1a42-43b9-95a6-cfc533646eaa tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:21.997743 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.network.neutron [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] validate_networks() for [('cac90707-8479-4653-a9fa-f25caced7385', None, None, None, None, None)] {{(pid=124189) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:46:22.024130 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f8aff52f-1a42-43b9-95a6-cfc533646eaa tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:22.062870 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f8aff52f-1a42-43b9-95a6-cfc533646eaa tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1236 microversion: 2.1 time: 0.283482 Jun 20 18:46:22.063990 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 13/25] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:21 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1236 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:22.090728 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-34440444-d73b-4fbd-98ed-6d8461863cc1 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e45e4b670>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:22.307394 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-34440444-d73b-4fbd-98ed-6d8461863cc1 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5" status: 200 len: 345 microversion: 2.1 time: 0.241563 Jun 20 18:46:22.308421 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 14/26] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:46:22 2022] GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5 => generated 345 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:22.315545 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-35bf0daf-e716-4f10-af5d-c3a5534a11af tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:22.315545 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-35bf0daf-e716-4f10-af5d-c3a5534a11af tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:22.503428 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-35bf0daf-e716-4f10-af5d-c3a5534a11af tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:22.514517 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-35bf0daf-e716-4f10-af5d-c3a5534a11af tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1215 microversion: 2.1 time: 0.203593 Jun 20 18:46:22.516204 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 15/27] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:22 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1215 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:23.044564 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Flavor limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:46:23.045208 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Image limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:46:23.045907 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Flavor pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:46:23.046552 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Image pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:46:23.047263 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:46:23.066863 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:23.067612 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:23.070429 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:23.071109 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:23.087756 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8aa807ac-a19d-4186-ac47-cb5d9cd2598d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:23.088592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8aa807ac-a19d-4186-ac47-cb5d9cd2598d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:23.169947 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Getting quotas for project b4944c36091d4f5f84e06386ee5a1589. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:46:23.188625 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Getting quotas for user 60a36e18710443359ba2a56ad2810043 and project b4944c36091d4f5f84e06386ee5a1589. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:46:23.235324 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Going to run 1 instances... {{(pid=124189) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:46:23.257129 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124189) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:46:23.311406 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8aa807ac-a19d-4186-ac47-cb5d9cd2598d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:23.320563 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8aa807ac-a19d-4186-ac47-cb5d9cd2598d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1236 microversion: 2.1 time: 0.242694 Jun 20 18:46:23.323906 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 16/28] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:23 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1236 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:23.341210 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4c46375f-71fe-4f49-a848-49b41a03dc70 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e45e66ca0>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:23.433952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4c46375f-71fe-4f49-a848-49b41a03dc70 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5" status: 200 len: 345 microversion: 2.1 time: 0.108042 Jun 20 18:46:23.434864 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 17/29] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:46:23 2022] GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5 => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:23.464953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-06bf4a10-6fdd-4806-a7d3-f3a135c28dee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.948049 Jun 20 18:46:23.471525 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 13/30] 10.222.0.43 () {62 vars in 1187 bytes} [Mon Jun 20 18:46:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 18:46:23.485066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6e3caeac-0be8-44de-a7be-b1ac14dc4ac5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:23.485803 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6e3caeac-0be8-44de-a7be-b1ac14dc4ac5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:23.532256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e635aa0d-18c0-425c-9d30-af073924ad3a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:23.533447 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e635aa0d-18c0-425c-9d30-af073924ad3a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:23.571761 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e635aa0d-18c0-425c-9d30-af073924ad3a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:23.572504 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e635aa0d-18c0-425c-9d30-af073924ad3a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:23.573074 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e635aa0d-18c0-425c-9d30-af073924ad3a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:23.573512 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e635aa0d-18c0-425c-9d30-af073924ad3a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:23.622741 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6e3caeac-0be8-44de-a7be-b1ac14dc4ac5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:23.631831 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6e3caeac-0be8-44de-a7be-b1ac14dc4ac5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:23.638369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6e3caeac-0be8-44de-a7be-b1ac14dc4ac5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:23.642252 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6e3caeac-0be8-44de-a7be-b1ac14dc4ac5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1282 microversion: 2.20 time: 0.164467 Jun 20 18:46:23.645893 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 18/31] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:23 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1282 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:46:24.032735 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e635aa0d-18c0-425c-9d30-af073924ad3a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:24.096473 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e635aa0d-18c0-425c-9d30-af073924ad3a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1219 microversion: 2.1 time: 0.569266 Jun 20 18:46:24.125862 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 14/32] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:23 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1219 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:24.342855 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8f323223-dce0-4f34-a9d5-d55b5d03e330 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:24.343508 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8f323223-dce0-4f34-a9d5-d55b5d03e330 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:24.358596 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8f323223-dce0-4f34-a9d5-d55b5d03e330 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:24.359494 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8f323223-dce0-4f34-a9d5-d55b5d03e330 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:24.360917 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8f323223-dce0-4f34-a9d5-d55b5d03e330 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:24.361718 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8f323223-dce0-4f34-a9d5-d55b5d03e330 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:24.447841 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-66f90080-92d4-40b2-973a-be5236f39dbc tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e455f4820>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:24.543580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8f323223-dce0-4f34-a9d5-d55b5d03e330 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:24.557277 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8f323223-dce0-4f34-a9d5-d55b5d03e330 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1240 microversion: 2.1 time: 0.218736 Jun 20 18:46:24.559108 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 19/33] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:24 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1240 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:24.573349 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-66f90080-92d4-40b2-973a-be5236f39dbc tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5" status: 200 len: 345 microversion: 2.1 time: 0.130136 Jun 20 18:46:24.574065 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 15/34] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:46:24 2022] GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5 => generated 345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:24.671449 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-15899390-60c5-4eb8-9667-427ee049e9e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:24.672383 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-15899390-60c5-4eb8-9667-427ee049e9e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:24.680878 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-15899390-60c5-4eb8-9667-427ee049e9e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:24.681543 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-15899390-60c5-4eb8-9667-427ee049e9e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:24.682724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-15899390-60c5-4eb8-9667-427ee049e9e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:24.683333 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-15899390-60c5-4eb8-9667-427ee049e9e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:24.821263 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-15899390-60c5-4eb8-9667-427ee049e9e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:24.830598 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-15899390-60c5-4eb8-9667-427ee049e9e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:24.838995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-15899390-60c5-4eb8-9667-427ee049e9e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:24.841711 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-15899390-60c5-4eb8-9667-427ee049e9e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1286 microversion: 2.20 time: 0.183304 Jun 20 18:46:24.843949 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 20/35] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:24 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1286 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:25.144560 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-bf9ca7e2-89ef-4bfa-b72b-81323653b78f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:25.145805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-bf9ca7e2-89ef-4bfa-b72b-81323653b78f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:25.155571 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bf9ca7e2-89ef-4bfa-b72b-81323653b78f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:25.156981 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bf9ca7e2-89ef-4bfa-b72b-81323653b78f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:25.161518 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bf9ca7e2-89ef-4bfa-b72b-81323653b78f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:25.162685 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bf9ca7e2-89ef-4bfa-b72b-81323653b78f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:25.287614 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-bf9ca7e2-89ef-4bfa-b72b-81323653b78f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:25.300889 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-bf9ca7e2-89ef-4bfa-b72b-81323653b78f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1211 microversion: 2.1 time: 0.160776 Jun 20 18:46:25.301449 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 16/36] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:25 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1211 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:25.576482 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-580d52f0-ab01-4b8f-98b0-55b5947e1309 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:25.578744 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-580d52f0-ab01-4b8f-98b0-55b5947e1309 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:25.588617 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-315c124e-55b3-45c0-acc9-15fab004390f tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e45e6eca0>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:25.617759 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-580d52f0-ab01-4b8f-98b0-55b5947e1309 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:25.619372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-580d52f0-ab01-4b8f-98b0-55b5947e1309 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:25.620664 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-580d52f0-ab01-4b8f-98b0-55b5947e1309 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:25.621319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-580d52f0-ab01-4b8f-98b0-55b5947e1309 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:25.726040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-315c124e-55b3-45c0-acc9-15fab004390f tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5" status: 200 len: 345 microversion: 2.1 time: 0.142505 Jun 20 18:46:25.727316 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 17/37] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:46:25 2022] GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5 => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:25.795018 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-580d52f0-ab01-4b8f-98b0-55b5947e1309 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:25.803940 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-580d52f0-ab01-4b8f-98b0-55b5947e1309 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1288 microversion: 2.1 time: 0.232119 Jun 20 18:46:25.810995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 21/38] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:25 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1288 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:25.843416 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-28429902", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26505b1c-460a-483f-99b8-daa82e0cee5d"}], "security_groups": [{"name": "tempest-securitygroup--2123374494"}], "key_name": "tempest-keypair-595114772", "user_data": "}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:46:25.863216 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b9a33aa1-2437-4842-8146-643c7a14fbaa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:25.864098 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b9a33aa1-2437-4842-8146-643c7a14fbaa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:25.873902 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b9a33aa1-2437-4842-8146-643c7a14fbaa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:25.875184 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b9a33aa1-2437-4842-8146-643c7a14fbaa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:25.876988 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b9a33aa1-2437-4842-8146-643c7a14fbaa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:25.877585 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b9a33aa1-2437-4842-8146-643c7a14fbaa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:26.004024 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.network.neutron [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] validate_networks() for [('26505b1c-460a-483f-99b8-daa82e0cee5d', None, None, None, None, None)] {{(pid=124189) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:46:26.046750 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b9a33aa1-2437-4842-8146-643c7a14fbaa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:26.066047 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b9a33aa1-2437-4842-8146-643c7a14fbaa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:26.076617 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b9a33aa1-2437-4842-8146-643c7a14fbaa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:26.082994 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b9a33aa1-2437-4842-8146-643c7a14fbaa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1334 microversion: 2.20 time: 0.223295 Jun 20 18:46:26.084755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 22/39] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:25 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1334 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:26.321897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-42686b16-01a5-4cee-b951-3ca8311eaaf0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:26.323065 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-42686b16-01a5-4cee-b951-3ca8311eaaf0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:26.345240 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-42686b16-01a5-4cee-b951-3ca8311eaaf0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:26.346963 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-42686b16-01a5-4cee-b951-3ca8311eaaf0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:26.349186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-42686b16-01a5-4cee-b951-3ca8311eaaf0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:26.355013 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-42686b16-01a5-4cee-b951-3ca8311eaaf0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:26.748089 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-42686b16-01a5-4cee-b951-3ca8311eaaf0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:26.767063 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-42686b16-01a5-4cee-b951-3ca8311eaaf0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1275 microversion: 2.1 time: 0.450652 Jun 20 18:46:26.770568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 23/40] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:26 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1275 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:26.793835 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ba632f50-0042-4532-8a01-0b0114ad0f6b tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e44d3ff70>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:26.894455 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-ba632f50-0042-4532-8a01-0b0114ad0f6b tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] HTTP exception thrown: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ba632f50-0042-4532-8a01-0b0114ad0f6b tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Request method failure captured: Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5 HTTP/1.1 Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMBonJuNbKcOTJ844PL_Yva8v8BI0Okr8rmHWyt88XPTp0J6yv6YfRwkXzzkrmtexKw1K2NPPnDSZZAPe3tVjSepINbPHVGSTc_yHpQXZhtwICMmWEhT7kbcDJIwhxp4y1_VYdD_la_HkmloUgEfysAlh0o2l9CSpSlLl-IPv97Kf_A Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 28aec5b111624af3a061ce7fd1a03b32 Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-905105355 Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:46:26.901786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:46:26.903173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_28aec5b111624af3a061ce7fd1a03b32", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/28aec5b111624af3a061ce7fd1a03b32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/28aec5b111624af3a061ce7fd1a03b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/28aec5b111624af3a061ce7fd1a03b32"}]}] Jun 20 18:46:26.903173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-VolumesSnapshotsTestJSON-905105355 Jun 20 18:46:26.903173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 28aec5b111624af3a061ce7fd1a03b32 Jun 20 18:46:26.903173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-905105355 Jun 20 18:46:26.903173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-VolumesSnapshotsTestJSON-905105355-project Jun 20 18:46:26.903173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:46:26.903173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:46:26.903173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: e13f3c0f9456465d8c9ceb206f958373 Jun 20 18:46:26.903173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-VolumesSnapshotsTestJSON-905105355-project Jun 20 18:46:26.903173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: Jun 20 18:46:26.903173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:26.903173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': '354cd26f-e405-4a41-b6e7-5de9798d64c5'} Jun 20 18:46:26.903173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. (HTTP 404) (Request-ID: req-881abd45-f87d-4676-89f2-eea2b9ec00d0) Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:46:26.904079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 18:46:26.907341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 18:46:26.909237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:46:26.910618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:26.910618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:26.910618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:46:26.910618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:26.910618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:26.910618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:46:26.910618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:46:26.910618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:46:26.910618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:46:26.910618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:26.910618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:26.914061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ba632f50-0042-4532-8a01-0b0114ad0f6b tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Returning 404 to user: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:46:26.915222 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ba632f50-0042-4532-8a01-0b0114ad0f6b tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5" status: 404 len: 109 microversion: 2.1 time: 0.143517 Jun 20 18:46:26.916868 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 24/41] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:46:26 2022] GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5 => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:46:26.925046 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-dba81b1d-dd45-4f9f-8891-ad825efa57d6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:26.925910 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-dba81b1d-dd45-4f9f-8891-ad825efa57d6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:26.937299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dba81b1d-dd45-4f9f-8891-ad825efa57d6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:26.938154 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dba81b1d-dd45-4f9f-8891-ad825efa57d6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:26.939300 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dba81b1d-dd45-4f9f-8891-ad825efa57d6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:26.940538 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dba81b1d-dd45-4f9f-8891-ad825efa57d6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:27.085946 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-dba81b1d-dd45-4f9f-8891-ad825efa57d6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:27.101921 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-dba81b1d-dd45-4f9f-8891-ad825efa57d6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1294 microversion: 2.1 time: 0.183363 Jun 20 18:46:27.125420 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 25/42] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:26 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1294 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:27.131081 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a77edf55-010e-4a3c-992e-b1ef71dea499 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e44de4e50>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:27.231728 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-a77edf55-010e-4a3c-992e-b1ef71dea499 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] HTTP exception thrown: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a77edf55-010e-4a3c-992e-b1ef71dea499 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Request method failure captured: Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: DELETE /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5 HTTP/1.1 Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMBonJuNbKcOTJ844PL_Yva8v8BI0Okr8rmHWyt88XPTp0J6yv6YfRwkXzzkrmtexKw1K2NPPnDSZZAPe3tVjSepINbPHVGSTc_yHpQXZhtwICMmWEhT7kbcDJIwhxp4y1_VYdD_la_HkmloUgEfysAlh0o2l9CSpSlLl-IPv97Kf_A Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 28aec5b111624af3a061ce7fd1a03b32 Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-905105355 Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:46:27.233674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:46:27.234755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_28aec5b111624af3a061ce7fd1a03b32", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/28aec5b111624af3a061ce7fd1a03b32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/28aec5b111624af3a061ce7fd1a03b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/28aec5b111624af3a061ce7fd1a03b32"}]}] Jun 20 18:46:27.234755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-VolumesSnapshotsTestJSON-905105355 Jun 20 18:46:27.234755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 28aec5b111624af3a061ce7fd1a03b32 Jun 20 18:46:27.234755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-905105355 Jun 20 18:46:27.234755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-VolumesSnapshotsTestJSON-905105355-project Jun 20 18:46:27.234755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:46:27.234755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:46:27.234755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: e13f3c0f9456465d8c9ceb206f958373 Jun 20 18:46:27.234755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-VolumesSnapshotsTestJSON-905105355-project Jun 20 18:46:27.234755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: Jun 20 18:46:27.234755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:27.234755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': '354cd26f-e405-4a41-b6e7-5de9798d64c5'} Jun 20 18:46:27.234755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. (HTTP 404) (Request-ID: req-28347f3d-7731-43c8-b064-264e64bda689) Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:46:27.235454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 18:46:27.236437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 18:46:27.237372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:46:27.238294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:27.238294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:27.238294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:46:27.238294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:27.238294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:27.238294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:46:27.238294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:46:27.238294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:46:27.238294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:46:27.238294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:27.238294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:27.238294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a77edf55-010e-4a3c-992e-b1ef71dea499 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Returning 404 to user: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:46:27.238294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a77edf55-010e-4a3c-992e-b1ef71dea499 tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5" status: 404 len: 109 microversion: 2.1 time: 0.108471 Jun 20 18:46:27.238294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 26/43] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jun 20 18:46:27 2022] DELETE /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:46:27.246435 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-128dd916-fa39-472c-ad8c-ce6d2e5dbce5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:27.247545 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-128dd916-fa39-472c-ad8c-ce6d2e5dbce5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:27.264672 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-128dd916-fa39-472c-ad8c-ce6d2e5dbce5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:27.265160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-128dd916-fa39-472c-ad8c-ce6d2e5dbce5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:27.265963 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-128dd916-fa39-472c-ad8c-ce6d2e5dbce5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:27.269140 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-128dd916-fa39-472c-ad8c-ce6d2e5dbce5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:27.629541 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-128dd916-fa39-472c-ad8c-ce6d2e5dbce5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:27.638754 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-128dd916-fa39-472c-ad8c-ce6d2e5dbce5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:27.640510 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-128dd916-fa39-472c-ad8c-ce6d2e5dbce5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:27.641722 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-128dd916-fa39-472c-ad8c-ce6d2e5dbce5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1340 microversion: 2.20 time: 0.401968 Jun 20 18:46:27.642530 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 27/44] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:27 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1340 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:27.657658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ec6a78ac-6045-4df6-917e-2a1769a13dcd tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Calling method '.version_select at 0x7f7e44d67e50>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:27.703189 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-ec6a78ac-6045-4df6-917e-2a1769a13dcd tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] HTTP exception thrown: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:27.706295 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Flavor limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ec6a78ac-6045-4df6-917e-2a1769a13dcd tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Request method failure captured: Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5 HTTP/1.1 Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMBonJuNbKcOTJ844PL_Yva8v8BI0Okr8rmHWyt88XPTp0J6yv6YfRwkXzzkrmtexKw1K2NPPnDSZZAPe3tVjSepINbPHVGSTc_yHpQXZhtwICMmWEhT7kbcDJIwhxp4y1_VYdD_la_HkmloUgEfysAlh0o2l9CSpSlLl-IPv97Kf_A Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 28aec5b111624af3a061ce7fd1a03b32 Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-905105355 Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:46:27.707079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:46:27.708186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_28aec5b111624af3a061ce7fd1a03b32", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/28aec5b111624af3a061ce7fd1a03b32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/28aec5b111624af3a061ce7fd1a03b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/28aec5b111624af3a061ce7fd1a03b32"}]}] Jun 20 18:46:27.708186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-VolumesSnapshotsTestJSON-905105355 Jun 20 18:46:27.708186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 28aec5b111624af3a061ce7fd1a03b32 Jun 20 18:46:27.708186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-905105355 Jun 20 18:46:27.708186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-VolumesSnapshotsTestJSON-905105355-project Jun 20 18:46:27.708186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:46:27.708186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:46:27.708186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: e13f3c0f9456465d8c9ceb206f958373 Jun 20 18:46:27.708186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-VolumesSnapshotsTestJSON-905105355-project Jun 20 18:46:27.708186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: Jun 20 18:46:27.708186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:27.708186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': '354cd26f-e405-4a41-b6e7-5de9798d64c5'} Jun 20 18:46:27.708186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. (HTTP 404) (Request-ID: req-9ebb9ae5-95b0-4e13-9e41-ac554e034a6e) Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:46:27.708820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 18:46:27.709724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 18:46:27.710658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:46:27.711616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:27.711616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:27.711616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:46:27.711616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:27.711616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:46:27.711616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:46:27.711616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:46:27.711616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:46:27.711616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:46:27.711616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. Jun 20 18:46:27.711616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:46:27.712160 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Image limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:46:27.712160 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Flavor pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:46:27.712160 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Image pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:46:27.712160 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:46:27.718030 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ec6a78ac-6045-4df6-917e-2a1769a13dcd tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] Returning 404 to user: Volume 354cd26f-e405-4a41-b6e7-5de9798d64c5 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:46:27.726502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ec6a78ac-6045-4df6-917e-2a1769a13dcd tempest-VolumesSnapshotsTestJSON-905105355 tempest-VolumesSnapshotsTestJSON-905105355-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5" status: 404 len: 109 microversion: 2.1 time: 0.075477 Jun 20 18:46:27.728928 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 28/45] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:46:27 2022] GET /compute/v2.1/os-volumes/354cd26f-e405-4a41-b6e7-5de9798d64c5 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:46:27.748511 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:27.748999 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:27.750541 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:27.751002 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:27.790250 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-69aea367-9f39-4721-9a10-929882bb6f10 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:27.790929 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-69aea367-9f39-4721-9a10-929882bb6f10 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:27.797670 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for project 8006d78bc1604611b3254b5efa451288. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:46:27.809107 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for user c3134832f2a647aab761da347f7e9fd4 and project 8006d78bc1604611b3254b5efa451288. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:46:27.810275 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-69aea367-9f39-4721-9a10-929882bb6f10 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:27.813335 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-69aea367-9f39-4721-9a10-929882bb6f10 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:27.817060 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-69aea367-9f39-4721-9a10-929882bb6f10 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:27.817648 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-69aea367-9f39-4721-9a10-929882bb6f10 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:27.843500 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Going to run 1 instances... {{(pid=124189) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:46:27.850188 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124189) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:46:27.962571 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ae62cf79-25ae-49af-8e9d-d40e33e97de2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.125002 Jun 20 18:46:27.964741 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 18/46] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:46:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 2128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:46:27.975135 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-55c2307f-508b-4949-b6b9-242d6f0eefd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:27.979429 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-55c2307f-508b-4949-b6b9-242d6f0eefd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:28.234863 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-69aea367-9f39-4721-9a10-929882bb6f10 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:28.251058 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-69aea367-9f39-4721-9a10-929882bb6f10 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1273 microversion: 2.1 time: 0.464284 Jun 20 18:46:28.270415 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 29/47] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:27 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1273 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:28.290386 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4f2bc2e6-4774-4a0c-9e19-25ac43997f6b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:28.291153 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-4f2bc2e6-4774-4a0c-9e19-25ac43997f6b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:28.311225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4f2bc2e6-4774-4a0c-9e19-25ac43997f6b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:28.311664 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4f2bc2e6-4774-4a0c-9e19-25ac43997f6b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:28.312453 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4f2bc2e6-4774-4a0c-9e19-25ac43997f6b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:28.312930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4f2bc2e6-4774-4a0c-9e19-25ac43997f6b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:28.623777 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4f2bc2e6-4774-4a0c-9e19-25ac43997f6b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:28.632623 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4f2bc2e6-4774-4a0c-9e19-25ac43997f6b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1294 microversion: 2.1 time: 0.357690 Jun 20 18:46:28.633720 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 30/48] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:28 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1294 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:28.663985 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-87f9fe11-f33a-4ca2-8b15-d0febbb0d597 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:28.665148 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-87f9fe11-f33a-4ca2-8b15-d0febbb0d597 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:28.718276 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-87f9fe11-f33a-4ca2-8b15-d0febbb0d597 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:28.723977 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-87f9fe11-f33a-4ca2-8b15-d0febbb0d597 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:28.730579 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-87f9fe11-f33a-4ca2-8b15-d0febbb0d597 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:28.731067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-87f9fe11-f33a-4ca2-8b15-d0febbb0d597 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:28.839333 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-55c2307f-508b-4949-b6b9-242d6f0eefd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:28.865654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-55c2307f-508b-4949-b6b9-242d6f0eefd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1239 microversion: 2.1 time: 0.894526 Jun 20 18:46:28.866511 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 19/49] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:27 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1239 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:29.210287 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-87f9fe11-f33a-4ca2-8b15-d0febbb0d597 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:29.256244 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-87f9fe11-f33a-4ca2-8b15-d0febbb0d597 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:29.258895 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-87f9fe11-f33a-4ca2-8b15-d0febbb0d597 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:29.270047 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-87f9fe11-f33a-4ca2-8b15-d0febbb0d597 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1340 microversion: 2.20 time: 0.602410 Jun 20 18:46:29.271380 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 31/50] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:28 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1340 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:46:29.302340 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a7599828-9bb1-4261-b0ac-e23b813e9a00 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:29.303607 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a7599828-9bb1-4261-b0ac-e23b813e9a00 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:29.319464 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a7599828-9bb1-4261-b0ac-e23b813e9a00 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:29.320062 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a7599828-9bb1-4261-b0ac-e23b813e9a00 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:29.323066 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a7599828-9bb1-4261-b0ac-e23b813e9a00 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:29.323790 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a7599828-9bb1-4261-b0ac-e23b813e9a00 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:29.624876 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a7599828-9bb1-4261-b0ac-e23b813e9a00 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:29.639519 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a7599828-9bb1-4261-b0ac-e23b813e9a00 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1273 microversion: 2.1 time: 0.350878 Jun 20 18:46:29.640163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 20/51] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:29 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1273 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:29.652665 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-11fd52d5-844d-4af6-9325-d946916bbfb9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:29.653649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-11fd52d5-844d-4af6-9325-d946916bbfb9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:29.669946 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11fd52d5-844d-4af6-9325-d946916bbfb9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:29.674547 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11fd52d5-844d-4af6-9325-d946916bbfb9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:29.679673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11fd52d5-844d-4af6-9325-d946916bbfb9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:29.681099 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11fd52d5-844d-4af6-9325-d946916bbfb9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:29.884562 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-25d1fc9d-886d-4efe-bf02-3ee14e704b13 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:29.885177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-25d1fc9d-886d-4efe-bf02-3ee14e704b13 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:29.894400 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-25d1fc9d-886d-4efe-bf02-3ee14e704b13 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:29.894855 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-25d1fc9d-886d-4efe-bf02-3ee14e704b13 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:29.905095 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-25d1fc9d-886d-4efe-bf02-3ee14e704b13 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:29.907299 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-25d1fc9d-886d-4efe-bf02-3ee14e704b13 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:30.508617 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-25d1fc9d-886d-4efe-bf02-3ee14e704b13 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:30.527968 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-25d1fc9d-886d-4efe-bf02-3ee14e704b13 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1291 microversion: 2.1 time: 0.647310 Jun 20 18:46:30.531606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 21/52] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:29 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1291 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:30.544450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f2305f15-601f-4141-99d1-17bfb9f6d43f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:30.551239 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f2305f15-601f-4141-99d1-17bfb9f6d43f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:30.575559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f2305f15-601f-4141-99d1-17bfb9f6d43f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:30.579203 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f2305f15-601f-4141-99d1-17bfb9f6d43f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:30.583160 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f2305f15-601f-4141-99d1-17bfb9f6d43f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:30.584415 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f2305f15-601f-4141-99d1-17bfb9f6d43f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:30.588505 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-11fd52d5-844d-4af6-9325-d946916bbfb9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:30.600628 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-11fd52d5-844d-4af6-9325-d946916bbfb9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1294 microversion: 2.1 time: 0.952739 Jun 20 18:46:30.603678 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 32/53] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:29 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1294 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:30.656669 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-3ff9ab75-154f-44a0-86ad-4fd793c040fb tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:30.657521 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-3ff9ab75-154f-44a0-86ad-4fd793c040fb tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:30.689679 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3ff9ab75-154f-44a0-86ad-4fd793c040fb tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:30.690257 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3ff9ab75-154f-44a0-86ad-4fd793c040fb tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:30.691121 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3ff9ab75-154f-44a0-86ad-4fd793c040fb tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:30.691561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3ff9ab75-154f-44a0-86ad-4fd793c040fb tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:30.766724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:31.479651 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-3ff9ab75-154f-44a0-86ad-4fd793c040fb tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:31.490488 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-3ff9ab75-154f-44a0-86ad-4fd793c040fb tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.837848 Jun 20 18:46:31.491102 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 33/54] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:30 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:31.552123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-cb58efca-9e11-45f7-af62-4836e4435799 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:31.552910 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-cb58efca-9e11-45f7-af62-4836e4435799 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:31.569319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cb58efca-9e11-45f7-af62-4836e4435799 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:31.572095 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cb58efca-9e11-45f7-af62-4836e4435799 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:31.573617 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cb58efca-9e11-45f7-af62-4836e4435799 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:31.575445 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cb58efca-9e11-45f7-af62-4836e4435799 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:31.613584 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f2305f15-601f-4141-99d1-17bfb9f6d43f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:31.622853 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f2305f15-601f-4141-99d1-17bfb9f6d43f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:31.624532 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f2305f15-601f-4141-99d1-17bfb9f6d43f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:31.636592 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f2305f15-601f-4141-99d1-17bfb9f6d43f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 1.103416 Jun 20 18:46:31.637396 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 22/55] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:30 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:31.653032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-cee3a896-c2ba-47c7-89c8-fc5b2c5b49ae tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:31.654015 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-cee3a896-c2ba-47c7-89c8-fc5b2c5b49ae tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:31.666189 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cee3a896-c2ba-47c7-89c8-fc5b2c5b49ae tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:31.667078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cee3a896-c2ba-47c7-89c8-fc5b2c5b49ae tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:31.669512 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cee3a896-c2ba-47c7-89c8-fc5b2c5b49ae tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:31.670630 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cee3a896-c2ba-47c7-89c8-fc5b2c5b49ae tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:32.017301 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cb58efca-9e11-45f7-af62-4836e4435799 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:32.034640 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-cb58efca-9e11-45f7-af62-4836e4435799 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1297 microversion: 2.1 time: 0.487705 Jun 20 18:46:32.043292 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 34/56] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:31 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1297 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:32.508534 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6e6da0e6-ce9e-409e-a417-c88ff261c1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:32.509144 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6e6da0e6-ce9e-409e-a417-c88ff261c1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:32.525111 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6e6da0e6-ce9e-409e-a417-c88ff261c1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:32.525834 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6e6da0e6-ce9e-409e-a417-c88ff261c1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:32.529306 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6e6da0e6-ce9e-409e-a417-c88ff261c1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:32.529998 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6e6da0e6-ce9e-409e-a417-c88ff261c1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:32.884047 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6e6da0e6-ce9e-409e-a417-c88ff261c1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:32.902528 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6e6da0e6-ce9e-409e-a417-c88ff261c1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.396542 Jun 20 18:46:32.905357 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 35/57] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:32 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:32.913874 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d16b76cd-e17c-4ab3-b52f-e77ccf965c32 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:32.918834 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d16b76cd-e17c-4ab3-b52f-e77ccf965c32 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:32.932780 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:32.935101 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d16b76cd-e17c-4ab3-b52f-e77ccf965c32 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:32.936613 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d16b76cd-e17c-4ab3-b52f-e77ccf965c32 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:32.937289 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d16b76cd-e17c-4ab3-b52f-e77ccf965c32 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:32.938096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d16b76cd-e17c-4ab3-b52f-e77ccf965c32 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:33.145152 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-cee3a896-c2ba-47c7-89c8-fc5b2c5b49ae tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:33.157495 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-cee3a896-c2ba-47c7-89c8-fc5b2c5b49ae tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 1.516439 Jun 20 18:46:33.158554 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 23/58] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:31 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:33.179111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-bb724823-a87c-47ce-8224-7e5808222f00 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:33.180127 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-bb724823-a87c-47ce-8224-7e5808222f00 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:33.204793 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bb724823-a87c-47ce-8224-7e5808222f00 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:33.205630 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bb724823-a87c-47ce-8224-7e5808222f00 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:33.206798 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bb724823-a87c-47ce-8224-7e5808222f00 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:33.207487 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bb724823-a87c-47ce-8224-7e5808222f00 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:33.630799 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=26 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:33.779185 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-bb724823-a87c-47ce-8224-7e5808222f00 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:33.804802 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-bb724823-a87c-47ce-8224-7e5808222f00 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1297 microversion: 2.1 time: 0.644742 Jun 20 18:46:33.807581 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 24/59] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:33 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1297 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:33.885424 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d16b76cd-e17c-4ab3-b52f-e77ccf965c32 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:33.895649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d16b76cd-e17c-4ab3-b52f-e77ccf965c32 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:33.897162 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d16b76cd-e17c-4ab3-b52f-e77ccf965c32 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:33.905844 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d16b76cd-e17c-4ab3-b52f-e77ccf965c32 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.999344 Jun 20 18:46:33.906715 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 36/60] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:32 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:33.927832 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d71bb148-51d0-4264-8296-f19d6bb43f2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:33.929780 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d71bb148-51d0-4264-8296-f19d6bb43f2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:33.954245 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d71bb148-51d0-4264-8296-f19d6bb43f2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:33.955731 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d71bb148-51d0-4264-8296-f19d6bb43f2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:33.957456 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d71bb148-51d0-4264-8296-f19d6bb43f2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:33.958640 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d71bb148-51d0-4264-8296-f19d6bb43f2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:34.177176 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-16e0a020-c31a-4b6a-bc79-ab5d76240908 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:34.178336 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-16e0a020-c31a-4b6a-bc79-ab5d76240908 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:34.198770 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-16e0a020-c31a-4b6a-bc79-ab5d76240908 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:34.201044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-16e0a020-c31a-4b6a-bc79-ab5d76240908 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:34.202494 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-16e0a020-c31a-4b6a-bc79-ab5d76240908 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:34.208681 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-16e0a020-c31a-4b6a-bc79-ab5d76240908 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:34.878062 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-16e0a020-c31a-4b6a-bc79-ab5d76240908 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:34.893469 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-16e0a020-c31a-4b6a-bc79-ab5d76240908 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.720953 Jun 20 18:46:34.898242 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 37/61] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:34 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:35.349141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d71bb148-51d0-4264-8296-f19d6bb43f2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:35.375154 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d71bb148-51d0-4264-8296-f19d6bb43f2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 1.452036 Jun 20 18:46:35.375818 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 25/62] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:33 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:35.402256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e1ffb42c-047d-475d-9c08-e02345cd45c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:35.404240 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e1ffb42c-047d-475d-9c08-e02345cd45c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:35.438021 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e1ffb42c-047d-475d-9c08-e02345cd45c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:35.440337 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e1ffb42c-047d-475d-9c08-e02345cd45c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:35.446075 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e1ffb42c-047d-475d-9c08-e02345cd45c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:35.446598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e1ffb42c-047d-475d-9c08-e02345cd45c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:35.456313 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-2c4ddc96-5c36-4298-a9db-c349064b29f3 req-61ebc71e-117e-4371-a401-bb7df82c3a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa52c387-5b77-4644-85c8-691b22dfeb78", "tag": "920abf72-084f-4d4e-be79-106c82668c67"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:46:35.493814 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-2c4ddc96-5c36-4298-a9db-c349064b29f3 req-61ebc71e-117e-4371-a401-bb7df82c3a0c service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:35.497171 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-2c4ddc96-5c36-4298-a9db-c349064b29f3 req-61ebc71e-117e-4371-a401-bb7df82c3a0c service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:35.557139 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=100 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:35.592669 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-2c4ddc96-5c36-4298-a9db-c349064b29f3 req-61ebc71e-117e-4371-a401-bb7df82c3a0c service nova] Creating event network-changed:920abf72-084f-4d4e-be79-106c82668c67 for instance aa52c387-5b77-4644-85c8-691b22dfeb78 on hv-cinder-83697 Jun 20 18:46:35.595277 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-2c4ddc96-5c36-4298-a9db-c349064b29f3 req-61ebc71e-117e-4371-a401-bb7df82c3a0c service nova] Acquired lock "compute-rpcapi-router" {{(pid=124190) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 18:46:35.604294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d5ef0e64-0b6e-4c33-b34f-ac7239552d48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:35.605299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d5ef0e64-0b6e-4c33-b34f-ac7239552d48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:35.606523 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d5ef0e64-0b6e-4c33-b34f-ac7239552d48 None None] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:35.607427 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d5ef0e64-0b6e-4c33-b34f-ac7239552d48 None None] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:35.621507 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.compute.rpcapi [None req-d5ef0e64-0b6e-4c33-b34f-ac7239552d48 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 18:46:35.623320 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d5ef0e64-0b6e-4c33-b34f-ac7239552d48 None None] Releasing lock "compute-rpcapi-router" {{(pid=124190) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 18:46:35.686851 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d5ef0e64-0b6e-4c33-b34f-ac7239552d48 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.787057 Jun 20 18:46:35.687747 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 38/63] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:35.693701 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ae285274-51cd-42ca-96d6-5d17ad6c0c84 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:35.696376 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ae285274-51cd-42ca-96d6-5d17ad6c0c84 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:35.714676 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ae285274-51cd-42ca-96d6-5d17ad6c0c84 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:35.715300 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ae285274-51cd-42ca-96d6-5d17ad6c0c84 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:35.716219 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ae285274-51cd-42ca-96d6-5d17ad6c0c84 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:35.716771 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ae285274-51cd-42ca-96d6-5d17ad6c0c84 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:35.754540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e1ffb42c-047d-475d-9c08-e02345cd45c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:35.769311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e1ffb42c-047d-475d-9c08-e02345cd45c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1297 microversion: 2.1 time: 0.389570 Jun 20 18:46:35.771679 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 26/64] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:35 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1297 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:35.913884 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d7eccdd5-8aed-428e-afa8-b92683ada6fa tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:35.915426 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d7eccdd5-8aed-428e-afa8-b92683ada6fa tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:35.940083 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d7eccdd5-8aed-428e-afa8-b92683ada6fa tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:35.940544 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d7eccdd5-8aed-428e-afa8-b92683ada6fa tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:35.942968 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d7eccdd5-8aed-428e-afa8-b92683ada6fa tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:35.943863 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d7eccdd5-8aed-428e-afa8-b92683ada6fa tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:36.583114 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d7eccdd5-8aed-428e-afa8-b92683ada6fa tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:36.598236 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d7eccdd5-8aed-428e-afa8-b92683ada6fa tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.690130 Jun 20 18:46:36.605608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 27/65] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:35 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:36.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-540cbc71-1355-4936-98f4-1db6a3ab02de tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:36.614391 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-540cbc71-1355-4936-98f4-1db6a3ab02de tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:36.624074 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-540cbc71-1355-4936-98f4-1db6a3ab02de tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:36.624524 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-540cbc71-1355-4936-98f4-1db6a3ab02de tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:36.625485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-540cbc71-1355-4936-98f4-1db6a3ab02de tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:36.626081 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-540cbc71-1355-4936-98f4-1db6a3ab02de tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:36.988913 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ae285274-51cd-42ca-96d6-5d17ad6c0c84 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:37.009690 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ae285274-51cd-42ca-96d6-5d17ad6c0c84 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:37.012444 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ae285274-51cd-42ca-96d6-5d17ad6c0c84 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:37.014437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ae285274-51cd-42ca-96d6-5d17ad6c0c84 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 1.325396 Jun 20 18:46:37.016258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 39/66] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:35 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:37.024359 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-49cb0500-6133-4a3d-9e2b-463341b179c7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:37.025830 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-49cb0500-6133-4a3d-9e2b-463341b179c7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:37.051685 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-49cb0500-6133-4a3d-9e2b-463341b179c7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:37.054250 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-49cb0500-6133-4a3d-9e2b-463341b179c7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:37.056576 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-49cb0500-6133-4a3d-9e2b-463341b179c7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:37.062059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-49cb0500-6133-4a3d-9e2b-463341b179c7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:37.397675 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-49cb0500-6133-4a3d-9e2b-463341b179c7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:37.409756 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-49cb0500-6133-4a3d-9e2b-463341b179c7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.391950 Jun 20 18:46:37.410349 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 40/67] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:37 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:37.481015 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-540cbc71-1355-4936-98f4-1db6a3ab02de tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:37.499452 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-540cbc71-1355-4936-98f4-1db6a3ab02de tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.892716 Jun 20 18:46:37.500576 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 28/68] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:36 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:37.619650 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e314d594-50aa-4395-aac2-712f14a5eded tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:37.620269 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e314d594-50aa-4395-aac2-712f14a5eded tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:37.642105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e314d594-50aa-4395-aac2-712f14a5eded tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:37.642609 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e314d594-50aa-4395-aac2-712f14a5eded tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:37.649256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e314d594-50aa-4395-aac2-712f14a5eded tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:37.649710 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e314d594-50aa-4395-aac2-712f14a5eded tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:38.034543 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6c4443d9-7731-4e60-821d-fa105c749baa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:38.035255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6c4443d9-7731-4e60-821d-fa105c749baa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:38.037800 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=6 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:38.050699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6c4443d9-7731-4e60-821d-fa105c749baa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:38.051178 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6c4443d9-7731-4e60-821d-fa105c749baa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:38.051971 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6c4443d9-7731-4e60-821d-fa105c749baa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:38.052407 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6c4443d9-7731-4e60-821d-fa105c749baa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:38.200535 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e314d594-50aa-4395-aac2-712f14a5eded tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:38.209070 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e314d594-50aa-4395-aac2-712f14a5eded tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.594527 Jun 20 18:46:38.210232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 41/69] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:37 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:38.658523 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-aeef853c-db94-42be-b6a2-e82377040a14 req-2e90f462-346b-4780-96d5-e8a8ea3376ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1fde39e-3570-4635-a3c3-b3aea5abf190", "tag": "afba41a9-6713-4c38-829a-4c3d915f0d01"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:46:38.680167 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-aeef853c-db94-42be-b6a2-e82377040a14 req-2e90f462-346b-4780-96d5-e8a8ea3376ac service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:38.683247 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-aeef853c-db94-42be-b6a2-e82377040a14 req-2e90f462-346b-4780-96d5-e8a8ea3376ac service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:38.710764 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-aeef853c-db94-42be-b6a2-e82377040a14 req-2e90f462-346b-4780-96d5-e8a8ea3376ac service nova] Creating event network-changed:afba41a9-6713-4c38-829a-4c3d915f0d01 for instance b1fde39e-3570-4635-a3c3-b3aea5abf190 on hv-cinder-83697 Jun 20 18:46:38.725770 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-aeef853c-db94-42be-b6a2-e82377040a14 req-2e90f462-346b-4780-96d5-e8a8ea3376ac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.514000 Jun 20 18:46:38.729350 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 42/70] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:38.741696 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-32f0ab82-5d05-4ee1-a96b-af7164e9e26e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:38.742408 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-32f0ab82-5d05-4ee1-a96b-af7164e9e26e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:38.761954 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-32f0ab82-5d05-4ee1-a96b-af7164e9e26e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:38.762404 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-32f0ab82-5d05-4ee1-a96b-af7164e9e26e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:38.763219 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-32f0ab82-5d05-4ee1-a96b-af7164e9e26e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:38.765019 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-32f0ab82-5d05-4ee1-a96b-af7164e9e26e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:38.855715 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6c4443d9-7731-4e60-821d-fa105c749baa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:38.857991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=20 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:38.868506 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6c4443d9-7731-4e60-821d-fa105c749baa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:38.872628 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6c4443d9-7731-4e60-821d-fa105c749baa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:38.873848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6c4443d9-7731-4e60-821d-fa105c749baa tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.843494 Jun 20 18:46:38.874451 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 29/71] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:38 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:38.910270 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ecdeee7a-53ff-44ab-917c-664c773ff6bc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:38.910868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ecdeee7a-53ff-44ab-917c-664c773ff6bc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:38.933476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ecdeee7a-53ff-44ab-917c-664c773ff6bc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:38.940358 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ecdeee7a-53ff-44ab-917c-664c773ff6bc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:38.944463 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ecdeee7a-53ff-44ab-917c-664c773ff6bc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:38.946305 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ecdeee7a-53ff-44ab-917c-664c773ff6bc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:39.184566 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-32f0ab82-5d05-4ee1-a96b-af7164e9e26e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:39.193655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-32f0ab82-5d05-4ee1-a96b-af7164e9e26e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.460905 Jun 20 18:46:39.195349 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 43/72] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:38 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:39.251038 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-80b52024-bc66-481a-9dc6-fb508cff20d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:39.252421 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-80b52024-bc66-481a-9dc6-fb508cff20d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:39.273691 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-80b52024-bc66-481a-9dc6-fb508cff20d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:39.279027 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-80b52024-bc66-481a-9dc6-fb508cff20d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:39.284335 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-80b52024-bc66-481a-9dc6-fb508cff20d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:39.288488 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-80b52024-bc66-481a-9dc6-fb508cff20d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:39.692431 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ecdeee7a-53ff-44ab-917c-664c773ff6bc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:39.709697 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ecdeee7a-53ff-44ab-917c-664c773ff6bc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.809680 Jun 20 18:46:39.721238 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 30/73] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:38 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:39.736509 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-80b52024-bc66-481a-9dc6-fb508cff20d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:39.745740 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-80b52024-bc66-481a-9dc6-fb508cff20d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.520642 Jun 20 18:46:39.746553 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 44/74] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:39 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:39.896609 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7faa815e-4d4c-4da8-a43d-aa38daffdbdb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:39.897569 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7faa815e-4d4c-4da8-a43d-aa38daffdbdb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:39.908436 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7faa815e-4d4c-4da8-a43d-aa38daffdbdb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:39.908626 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7faa815e-4d4c-4da8-a43d-aa38daffdbdb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:39.909699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7faa815e-4d4c-4da8-a43d-aa38daffdbdb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:39.910341 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7faa815e-4d4c-4da8-a43d-aa38daffdbdb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:40.184195 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7faa815e-4d4c-4da8-a43d-aa38daffdbdb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:40.200777 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7faa815e-4d4c-4da8-a43d-aa38daffdbdb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:40.203038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7faa815e-4d4c-4da8-a43d-aa38daffdbdb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:40.211867 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0d362159-c614-4b49-8ce8-00d77dd8a16a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:40.212508 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0d362159-c614-4b49-8ce8-00d77dd8a16a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:40.215690 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7faa815e-4d4c-4da8-a43d-aa38daffdbdb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.315478 Jun 20 18:46:40.220313 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 31/75] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:39 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:40.223299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0d362159-c614-4b49-8ce8-00d77dd8a16a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:40.223752 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0d362159-c614-4b49-8ce8-00d77dd8a16a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:40.228201 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0d362159-c614-4b49-8ce8-00d77dd8a16a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:40.228722 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0d362159-c614-4b49-8ce8-00d77dd8a16a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:40.414186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0d362159-c614-4b49-8ce8-00d77dd8a16a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:40.422834 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0d362159-c614-4b49-8ce8-00d77dd8a16a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.214784 Jun 20 18:46:40.424646 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 45/76] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:40 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:40.727340 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b1d9ba5c-f795-40d8-b848-075aa99de984 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:40.728472 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b1d9ba5c-f795-40d8-b848-075aa99de984 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:40.734431 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b1d9ba5c-f795-40d8-b848-075aa99de984 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:40.734984 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b1d9ba5c-f795-40d8-b848-075aa99de984 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:40.746048 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b1d9ba5c-f795-40d8-b848-075aa99de984 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:40.746164 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-e73d18fa-4944-4ab5-91ab-82b65e768f1d req-bb935c1d-1482-4095-9d73-c79ea6c7984b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2614c08f-0c19-4066-8c87-551d4ac2f725", "tag": "ffa2211c-05a6-4fea-b138-2d18f0a69e0b"}, {"name": "network-changed", "server_uuid": "bf3d4888-1358-407b-9677-a8887d92ea3a", "tag": "2f87729e-9bda-4418-ae91-a86c8903e7f2"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:46:40.746751 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b1d9ba5c-f795-40d8-b848-075aa99de984 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:40.755720 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-e73d18fa-4944-4ab5-91ab-82b65e768f1d req-bb935c1d-1482-4095-9d73-c79ea6c7984b service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:40.756160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-e73d18fa-4944-4ab5-91ab-82b65e768f1d req-bb935c1d-1482-4095-9d73-c79ea6c7984b service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:40.769918 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-e73d18fa-4944-4ab5-91ab-82b65e768f1d req-bb935c1d-1482-4095-9d73-c79ea6c7984b service nova] Creating event network-changed:ffa2211c-05a6-4fea-b138-2d18f0a69e0b for instance 2614c08f-0c19-4066-8c87-551d4ac2f725 on hv-cinder-83697 Jun 20 18:46:40.770420 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-e73d18fa-4944-4ab5-91ab-82b65e768f1d req-bb935c1d-1482-4095-9d73-c79ea6c7984b service nova] Creating event network-changed:2f87729e-9bda-4418-ae91-a86c8903e7f2 for instance bf3d4888-1358-407b-9677-a8887d92ea3a on hv-cinder-83697 Jun 20 18:46:40.776806 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-e73d18fa-4944-4ab5-91ab-82b65e768f1d req-bb935c1d-1482-4095-9d73-c79ea6c7984b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033959 Jun 20 18:46:40.777708 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 46/77] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:40.783384 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-60b7a951-4ecc-480c-a948-a75ab77a8076 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:40.784090 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-60b7a951-4ecc-480c-a948-a75ab77a8076 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:40.790632 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-60b7a951-4ecc-480c-a948-a75ab77a8076 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:40.791275 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-60b7a951-4ecc-480c-a948-a75ab77a8076 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:40.792193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-60b7a951-4ecc-480c-a948-a75ab77a8076 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:40.792772 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-60b7a951-4ecc-480c-a948-a75ab77a8076 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:40.920763 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b1d9ba5c-f795-40d8-b848-075aa99de984 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:40.930137 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b1d9ba5c-f795-40d8-b848-075aa99de984 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.206889 Jun 20 18:46:40.931886 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 32/78] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:40 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:40.987973 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-60b7a951-4ecc-480c-a948-a75ab77a8076 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:40.995779 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-60b7a951-4ecc-480c-a948-a75ab77a8076 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.216841 Jun 20 18:46:40.996339 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 47/79] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:40 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:41.241776 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1909c4f8-8253-47bd-ad54-3a77d2689fa2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:41.242540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1909c4f8-8253-47bd-ad54-3a77d2689fa2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:41.248859 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1909c4f8-8253-47bd-ad54-3a77d2689fa2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:41.249346 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1909c4f8-8253-47bd-ad54-3a77d2689fa2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:41.250147 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1909c4f8-8253-47bd-ad54-3a77d2689fa2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:41.250595 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1909c4f8-8253-47bd-ad54-3a77d2689fa2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:41.277204 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:41.441059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-232dc32a-7f0e-444e-be1b-5174709877a9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:41.441810 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-232dc32a-7f0e-444e-be1b-5174709877a9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:41.451567 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-232dc32a-7f0e-444e-be1b-5174709877a9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:41.451946 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-232dc32a-7f0e-444e-be1b-5174709877a9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:41.455309 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-232dc32a-7f0e-444e-be1b-5174709877a9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:41.457595 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-232dc32a-7f0e-444e-be1b-5174709877a9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:41.644725 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-232dc32a-7f0e-444e-be1b-5174709877a9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:41.652331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-232dc32a-7f0e-444e-be1b-5174709877a9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.216024 Jun 20 18:46:41.652996 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 48/80] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:41 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:41.661460 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1909c4f8-8253-47bd-ad54-3a77d2689fa2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:41.669527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1909c4f8-8253-47bd-ad54-3a77d2689fa2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:41.671263 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1909c4f8-8253-47bd-ad54-3a77d2689fa2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:41.672343 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1909c4f8-8253-47bd-ad54-3a77d2689fa2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.436418 Jun 20 18:46:41.672898 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 33/81] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:41 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:41.948525 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-081d945d-d278-4824-be45-32bb1d2a1e8c tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:41.949425 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-081d945d-d278-4824-be45-32bb1d2a1e8c tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:41.956583 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-081d945d-d278-4824-be45-32bb1d2a1e8c tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:41.957292 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-081d945d-d278-4824-be45-32bb1d2a1e8c tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:41.958517 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-081d945d-d278-4824-be45-32bb1d2a1e8c tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:41.959269 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-081d945d-d278-4824-be45-32bb1d2a1e8c tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:42.019458 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7dec6d17-f01c-4037-b967-e0bd40de17dd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:42.021978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7dec6d17-f01c-4037-b967-e0bd40de17dd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:42.037110 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7dec6d17-f01c-4037-b967-e0bd40de17dd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:42.039310 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7dec6d17-f01c-4037-b967-e0bd40de17dd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:42.040773 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7dec6d17-f01c-4037-b967-e0bd40de17dd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:42.042154 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7dec6d17-f01c-4037-b967-e0bd40de17dd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:42.140401 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-081d945d-d278-4824-be45-32bb1d2a1e8c tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:42.161282 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-081d945d-d278-4824-be45-32bb1d2a1e8c tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.216596 Jun 20 18:46:42.162393 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 49/82] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:41 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:42.219970 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7dec6d17-f01c-4037-b967-e0bd40de17dd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:42.229111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7dec6d17-f01c-4037-b967-e0bd40de17dd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.218652 Jun 20 18:46:42.239274 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 34/83] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:42 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:42.669814 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d259eccf-aff4-4c7f-88b0-6c58fdfd5957 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:42.671181 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d259eccf-aff4-4c7f-88b0-6c58fdfd5957 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:42.678494 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d259eccf-aff4-4c7f-88b0-6c58fdfd5957 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:42.679480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d259eccf-aff4-4c7f-88b0-6c58fdfd5957 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:42.680871 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d259eccf-aff4-4c7f-88b0-6c58fdfd5957 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:42.681497 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d259eccf-aff4-4c7f-88b0-6c58fdfd5957 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:42.702113 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-378098df-35e9-4795-8da9-2f7419191295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:42.705518 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-378098df-35e9-4795-8da9-2f7419191295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:42.716210 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-378098df-35e9-4795-8da9-2f7419191295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:42.716931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-378098df-35e9-4795-8da9-2f7419191295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:42.718526 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-378098df-35e9-4795-8da9-2f7419191295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:42.719294 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-378098df-35e9-4795-8da9-2f7419191295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:42.889958 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-378098df-35e9-4795-8da9-2f7419191295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:42.898627 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-378098df-35e9-4795-8da9-2f7419191295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:42.900384 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-378098df-35e9-4795-8da9-2f7419191295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:42.901821 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-378098df-35e9-4795-8da9-2f7419191295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.215854 Jun 20 18:46:42.902441 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 35/84] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:42 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:42.926379 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d259eccf-aff4-4c7f-88b0-6c58fdfd5957 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:42.935070 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d259eccf-aff4-4c7f-88b0-6c58fdfd5957 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.269807 Jun 20 18:46:42.935644 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 50/85] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:42 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:43.178204 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5f38533d-9af6-4536-80b1-8fa0ef8359c9 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:43.179126 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5f38533d-9af6-4536-80b1-8fa0ef8359c9 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:43.185803 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5f38533d-9af6-4536-80b1-8fa0ef8359c9 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:43.186256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5f38533d-9af6-4536-80b1-8fa0ef8359c9 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:43.187045 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5f38533d-9af6-4536-80b1-8fa0ef8359c9 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:43.187483 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5f38533d-9af6-4536-80b1-8fa0ef8359c9 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:43.245548 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f179a8a0-3f0e-4ac3-9937-c7407daac628 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:43.246416 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f179a8a0-3f0e-4ac3-9937-c7407daac628 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:43.259794 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f179a8a0-3f0e-4ac3-9937-c7407daac628 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:43.260739 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f179a8a0-3f0e-4ac3-9937-c7407daac628 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:43.261619 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f179a8a0-3f0e-4ac3-9937-c7407daac628 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:43.262160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f179a8a0-3f0e-4ac3-9937-c7407daac628 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:43.368044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5f38533d-9af6-4536-80b1-8fa0ef8359c9 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:43.380090 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5f38533d-9af6-4536-80b1-8fa0ef8359c9 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.205754 Jun 20 18:46:43.382888 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 36/86] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:43 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:43.420589 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f179a8a0-3f0e-4ac3-9937-c7407daac628 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:43.429763 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f179a8a0-3f0e-4ac3-9937-c7407daac628 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.187735 Jun 20 18:46:43.441010 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 51/87] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:43 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:43.920182 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f238aa51-eb50-4668-94ce-f3cae5392206 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:43.920785 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f238aa51-eb50-4668-94ce-f3cae5392206 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:43.926843 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f238aa51-eb50-4668-94ce-f3cae5392206 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:43.927321 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f238aa51-eb50-4668-94ce-f3cae5392206 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:43.928091 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f238aa51-eb50-4668-94ce-f3cae5392206 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:43.928519 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f238aa51-eb50-4668-94ce-f3cae5392206 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:43.952701 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-013d6fa4-1d54-4ab1-bd20-74c33d321077 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:43.953865 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-013d6fa4-1d54-4ab1-bd20-74c33d321077 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:43.961258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-013d6fa4-1d54-4ab1-bd20-74c33d321077 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:43.961693 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-013d6fa4-1d54-4ab1-bd20-74c33d321077 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:43.963025 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-013d6fa4-1d54-4ab1-bd20-74c33d321077 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:43.963639 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-013d6fa4-1d54-4ab1-bd20-74c33d321077 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:44.083639 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f238aa51-eb50-4668-94ce-f3cae5392206 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:44.100579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f238aa51-eb50-4668-94ce-f3cae5392206 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:44.102074 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f238aa51-eb50-4668-94ce-f3cae5392206 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:44.103190 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f238aa51-eb50-4668-94ce-f3cae5392206 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.187315 Jun 20 18:46:44.103740 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 37/88] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:43 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:44.148800 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-013d6fa4-1d54-4ab1-bd20-74c33d321077 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:44.159713 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-013d6fa4-1d54-4ab1-bd20-74c33d321077 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.211139 Jun 20 18:46:44.161547 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 52/89] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:43 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:44.398405 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f20f6036-d7d5-42b2-9b1f-427d99ba8d97 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:44.399673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f20f6036-d7d5-42b2-9b1f-427d99ba8d97 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:44.406646 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f20f6036-d7d5-42b2-9b1f-427d99ba8d97 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:44.407132 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f20f6036-d7d5-42b2-9b1f-427d99ba8d97 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:44.407915 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f20f6036-d7d5-42b2-9b1f-427d99ba8d97 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:44.408342 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f20f6036-d7d5-42b2-9b1f-427d99ba8d97 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:44.449130 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b51cb285-852d-4aa6-b14f-cd6c11ae74f1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:44.449852 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b51cb285-852d-4aa6-b14f-cd6c11ae74f1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:44.459712 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b51cb285-852d-4aa6-b14f-cd6c11ae74f1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:44.460568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b51cb285-852d-4aa6-b14f-cd6c11ae74f1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:44.461665 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b51cb285-852d-4aa6-b14f-cd6c11ae74f1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:44.462699 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b51cb285-852d-4aa6-b14f-cd6c11ae74f1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:44.625175 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f20f6036-d7d5-42b2-9b1f-427d99ba8d97 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:44.635469 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f20f6036-d7d5-42b2-9b1f-427d99ba8d97 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.241248 Jun 20 18:46:44.639116 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 38/90] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:44 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:44.646856 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b51cb285-852d-4aa6-b14f-cd6c11ae74f1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:44.655381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b51cb285-852d-4aa6-b14f-cd6c11ae74f1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.212098 Jun 20 18:46:44.655948 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 53/91] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:44 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:45.121556 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1c01c47b-e0b9-4011-861a-a483b3e44955 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:45.122152 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1c01c47b-e0b9-4011-861a-a483b3e44955 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:45.125007 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:45.128927 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1c01c47b-e0b9-4011-861a-a483b3e44955 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:45.138595 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1c01c47b-e0b9-4011-861a-a483b3e44955 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:45.138595 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1c01c47b-e0b9-4011-861a-a483b3e44955 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:45.138595 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1c01c47b-e0b9-4011-861a-a483b3e44955 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:45.177906 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-450eecdd-3fc3-4aa1-bb2e-b93b4fab6e96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:45.178513 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-450eecdd-3fc3-4aa1-bb2e-b93b4fab6e96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:45.184851 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-450eecdd-3fc3-4aa1-bb2e-b93b4fab6e96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:45.185307 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-450eecdd-3fc3-4aa1-bb2e-b93b4fab6e96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:45.186074 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-450eecdd-3fc3-4aa1-bb2e-b93b4fab6e96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:45.186510 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-450eecdd-3fc3-4aa1-bb2e-b93b4fab6e96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:45.282102 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1c01c47b-e0b9-4011-861a-a483b3e44955 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:45.292186 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1c01c47b-e0b9-4011-861a-a483b3e44955 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:45.293717 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1c01c47b-e0b9-4011-861a-a483b3e44955 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:45.294823 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1c01c47b-e0b9-4011-861a-a483b3e44955 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.177339 Jun 20 18:46:45.295752 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 39/92] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:45 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:45.326269 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-450eecdd-3fc3-4aa1-bb2e-b93b4fab6e96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:45.334292 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-450eecdd-3fc3-4aa1-bb2e-b93b4fab6e96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.160590 Jun 20 18:46:45.334851 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 54/93] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:45 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:45.653305 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fbbef7c1-607c-4159-9242-520b8c6f12dc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:45.653985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fbbef7c1-607c-4159-9242-520b8c6f12dc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:45.660077 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fbbef7c1-607c-4159-9242-520b8c6f12dc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:45.660524 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fbbef7c1-607c-4159-9242-520b8c6f12dc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:45.661281 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fbbef7c1-607c-4159-9242-520b8c6f12dc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:45.661720 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fbbef7c1-607c-4159-9242-520b8c6f12dc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:45.672176 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f1a71750-53dc-47a9-9450-007ebb8714b6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:45.672976 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f1a71750-53dc-47a9-9450-007ebb8714b6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:45.674889 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:45.682463 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f1a71750-53dc-47a9-9450-007ebb8714b6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:45.683882 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f1a71750-53dc-47a9-9450-007ebb8714b6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:45.684948 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f1a71750-53dc-47a9-9450-007ebb8714b6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:45.685523 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f1a71750-53dc-47a9-9450-007ebb8714b6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:45.799288 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fbbef7c1-607c-4159-9242-520b8c6f12dc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:45.808335 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fbbef7c1-607c-4159-9242-520b8c6f12dc tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.158806 Jun 20 18:46:45.809139 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 40/94] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:45 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:45.831664 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f1a71750-53dc-47a9-9450-007ebb8714b6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:45.840419 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f1a71750-53dc-47a9-9450-007ebb8714b6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.171864 Jun 20 18:46:45.841004 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 55/95] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:45 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:46.313179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e93806c3-c54e-4451-b6e2-7e5056c6fbd0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:46.313802 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e93806c3-c54e-4451-b6e2-7e5056c6fbd0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:46.320425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e93806c3-c54e-4451-b6e2-7e5056c6fbd0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:46.320870 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e93806c3-c54e-4451-b6e2-7e5056c6fbd0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:46.321628 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e93806c3-c54e-4451-b6e2-7e5056c6fbd0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:46.322053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e93806c3-c54e-4451-b6e2-7e5056c6fbd0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:46.352562 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1aa48b86-55be-4127-83f5-0e3a2319915f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:46.353882 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1aa48b86-55be-4127-83f5-0e3a2319915f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:46.360325 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1aa48b86-55be-4127-83f5-0e3a2319915f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:46.361033 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1aa48b86-55be-4127-83f5-0e3a2319915f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:46.361873 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1aa48b86-55be-4127-83f5-0e3a2319915f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:46.362217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1aa48b86-55be-4127-83f5-0e3a2319915f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:46.388690 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=100 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:46.459427 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e93806c3-c54e-4451-b6e2-7e5056c6fbd0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:46.467339 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e93806c3-c54e-4451-b6e2-7e5056c6fbd0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:46.468884 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e93806c3-c54e-4451-b6e2-7e5056c6fbd0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:46.469972 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e93806c3-c54e-4451-b6e2-7e5056c6fbd0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.160818 Jun 20 18:46:46.471081 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 41/96] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:46 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:46.574909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-1aa48b86-55be-4127-83f5-0e3a2319915f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:46.583553 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1aa48b86-55be-4127-83f5-0e3a2319915f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.236158 Jun 20 18:46:46.584339 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 56/97] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:46 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:46.825627 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e6d312c8-3f44-4d6c-a7ae-67898e9a4503 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:46.826274 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e6d312c8-3f44-4d6c-a7ae-67898e9a4503 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:46.835530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e6d312c8-3f44-4d6c-a7ae-67898e9a4503 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:46.835969 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e6d312c8-3f44-4d6c-a7ae-67898e9a4503 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:46.836755 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e6d312c8-3f44-4d6c-a7ae-67898e9a4503 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:46.837184 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e6d312c8-3f44-4d6c-a7ae-67898e9a4503 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:46.858752 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2c313980-b81b-4c53-888e-f663af9872a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:46.860044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2c313980-b81b-4c53-888e-f663af9872a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:46.884066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2c313980-b81b-4c53-888e-f663af9872a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:46.884715 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2c313980-b81b-4c53-888e-f663af9872a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:46.885674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2c313980-b81b-4c53-888e-f663af9872a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:46.886125 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2c313980-b81b-4c53-888e-f663af9872a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:46.979339 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e6d312c8-3f44-4d6c-a7ae-67898e9a4503 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:46.988478 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e6d312c8-3f44-4d6c-a7ae-67898e9a4503 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.166678 Jun 20 18:46:46.989125 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 42/98] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:46 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:47.090494 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2c313980-b81b-4c53-888e-f663af9872a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:47.098335 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2c313980-b81b-4c53-888e-f663af9872a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.244717 Jun 20 18:46:47.098902 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 57/99] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:46 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:47.488290 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0e990d5d-a1b2-4f6b-8d89-0908aa83284d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:47.488957 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0e990d5d-a1b2-4f6b-8d89-0908aa83284d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:47.495764 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0e990d5d-a1b2-4f6b-8d89-0908aa83284d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:47.496208 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0e990d5d-a1b2-4f6b-8d89-0908aa83284d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:47.496957 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0e990d5d-a1b2-4f6b-8d89-0908aa83284d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:47.497384 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0e990d5d-a1b2-4f6b-8d89-0908aa83284d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:47.601233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0b45cbe8-e88c-44da-9dd9-252fc0638322 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:47.602000 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0b45cbe8-e88c-44da-9dd9-252fc0638322 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:47.608777 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0b45cbe8-e88c-44da-9dd9-252fc0638322 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:47.609311 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0b45cbe8-e88c-44da-9dd9-252fc0638322 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:47.610151 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0b45cbe8-e88c-44da-9dd9-252fc0638322 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:47.610656 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0b45cbe8-e88c-44da-9dd9-252fc0638322 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:47.633673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0e990d5d-a1b2-4f6b-8d89-0908aa83284d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:47.643251 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0e990d5d-a1b2-4f6b-8d89-0908aa83284d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:47.644761 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0e990d5d-a1b2-4f6b-8d89-0908aa83284d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:47.646109 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0e990d5d-a1b2-4f6b-8d89-0908aa83284d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.161713 Jun 20 18:46:47.646667 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 43/100] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:47 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:47.759771 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0b45cbe8-e88c-44da-9dd9-252fc0638322 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:47.770655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0b45cbe8-e88c-44da-9dd9-252fc0638322 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.173307 Jun 20 18:46:47.771364 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 58/101] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:47 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:48.005871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9b68babb-00b9-4688-a73d-0dedd2e3a1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:48.006473 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9b68babb-00b9-4688-a73d-0dedd2e3a1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:48.012329 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9b68babb-00b9-4688-a73d-0dedd2e3a1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:48.012773 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9b68babb-00b9-4688-a73d-0dedd2e3a1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:48.013518 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9b68babb-00b9-4688-a73d-0dedd2e3a1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:48.013944 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9b68babb-00b9-4688-a73d-0dedd2e3a1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:48.114594 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e0545493-1e7f-438e-ade5-d8d17af8b7d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:48.115244 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e0545493-1e7f-438e-ade5-d8d17af8b7d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:48.121540 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0545493-1e7f-438e-ade5-d8d17af8b7d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:48.122241 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0545493-1e7f-438e-ade5-d8d17af8b7d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:48.123026 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0545493-1e7f-438e-ade5-d8d17af8b7d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:48.123463 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0545493-1e7f-438e-ade5-d8d17af8b7d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:48.144376 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9b68babb-00b9-4688-a73d-0dedd2e3a1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:48.151985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9b68babb-00b9-4688-a73d-0dedd2e3a1d4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.150368 Jun 20 18:46:48.152581 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 44/102] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:48 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:48.256636 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e0545493-1e7f-438e-ade5-d8d17af8b7d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:48.264226 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e0545493-1e7f-438e-ade5-d8d17af8b7d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.153892 Jun 20 18:46:48.264788 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 59/103] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:48 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:48.664117 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f3466ce5-d21f-4314-b1f9-df30929865d4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:48.664636 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f3466ce5-d21f-4314-b1f9-df30929865d4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:48.670868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f3466ce5-d21f-4314-b1f9-df30929865d4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:48.671347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f3466ce5-d21f-4314-b1f9-df30929865d4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:48.672106 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f3466ce5-d21f-4314-b1f9-df30929865d4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:48.672736 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f3466ce5-d21f-4314-b1f9-df30929865d4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:48.787223 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-668e8e71-7149-4280-8859-82fdacd214f0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:48.787867 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-668e8e71-7149-4280-8859-82fdacd214f0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:48.799053 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-668e8e71-7149-4280-8859-82fdacd214f0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:48.800546 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-668e8e71-7149-4280-8859-82fdacd214f0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:48.811682 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-668e8e71-7149-4280-8859-82fdacd214f0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:48.812953 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-668e8e71-7149-4280-8859-82fdacd214f0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:48.821055 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f3466ce5-d21f-4314-b1f9-df30929865d4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:48.829109 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f3466ce5-d21f-4314-b1f9-df30929865d4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:48.830684 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f3466ce5-d21f-4314-b1f9-df30929865d4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:48.832059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f3466ce5-d21f-4314-b1f9-df30929865d4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.171916 Jun 20 18:46:48.832614 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 45/104] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:48 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:48.951953 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-668e8e71-7149-4280-8859-82fdacd214f0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:48.959616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-668e8e71-7149-4280-8859-82fdacd214f0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.176914 Jun 20 18:46:48.960232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 60/105] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:48 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:49.168322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c2154dd5-68fa-4a15-8b36-d594401e380a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:49.168931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c2154dd5-68fa-4a15-8b36-d594401e380a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:49.175452 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2154dd5-68fa-4a15-8b36-d594401e380a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:49.175840 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2154dd5-68fa-4a15-8b36-d594401e380a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:49.176597 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2154dd5-68fa-4a15-8b36-d594401e380a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:49.177029 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2154dd5-68fa-4a15-8b36-d594401e380a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:49.283066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-63c551ec-32fc-4507-a6f4-312105ac4261 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:49.287230 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-63c551ec-32fc-4507-a6f4-312105ac4261 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:49.294174 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-63c551ec-32fc-4507-a6f4-312105ac4261 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:49.294815 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-63c551ec-32fc-4507-a6f4-312105ac4261 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:49.295762 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-63c551ec-32fc-4507-a6f4-312105ac4261 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:49.296336 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-63c551ec-32fc-4507-a6f4-312105ac4261 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:49.313256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c2154dd5-68fa-4a15-8b36-d594401e380a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:49.322093 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c2154dd5-68fa-4a15-8b36-d594401e380a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.157387 Jun 20 18:46:49.323172 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 46/106] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:49 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:49.434997 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-63c551ec-32fc-4507-a6f4-312105ac4261 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:49.442569 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-63c551ec-32fc-4507-a6f4-312105ac4261 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.164868 Jun 20 18:46:49.443160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 61/107] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:49 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:49.852270 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fb0ac21e-faba-4437-9139-4619a1642c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:49.853374 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fb0ac21e-faba-4437-9139-4619a1642c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:49.860483 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb0ac21e-faba-4437-9139-4619a1642c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:49.861540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb0ac21e-faba-4437-9139-4619a1642c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:49.862368 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb0ac21e-faba-4437-9139-4619a1642c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:49.863135 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb0ac21e-faba-4437-9139-4619a1642c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:49.976602 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6ac7758e-e66b-404f-9e4c-3cb007cb57ca tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:49.977337 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6ac7758e-e66b-404f-9e4c-3cb007cb57ca tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:49.984516 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6ac7758e-e66b-404f-9e4c-3cb007cb57ca tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:49.985072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6ac7758e-e66b-404f-9e4c-3cb007cb57ca tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:49.985849 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6ac7758e-e66b-404f-9e4c-3cb007cb57ca tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:49.986287 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6ac7758e-e66b-404f-9e4c-3cb007cb57ca tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:49.999013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fb0ac21e-faba-4437-9139-4619a1642c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:50.007559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fb0ac21e-faba-4437-9139-4619a1642c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:50.009053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fb0ac21e-faba-4437-9139-4619a1642c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:50.010132 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fb0ac21e-faba-4437-9139-4619a1642c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.163513 Jun 20 18:46:50.010683 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 47/108] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:49 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:50.116292 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6ac7758e-e66b-404f-9e4c-3cb007cb57ca tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:50.123602 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6ac7758e-e66b-404f-9e4c-3cb007cb57ca tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.151026 Jun 20 18:46:50.124145 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 62/109] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:49 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:50.339262 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-511d5502-c539-4525-b02a-2a899230c84a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:50.339864 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-511d5502-c539-4525-b02a-2a899230c84a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:50.346580 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-511d5502-c539-4525-b02a-2a899230c84a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:50.347052 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-511d5502-c539-4525-b02a-2a899230c84a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:50.347795 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-511d5502-c539-4525-b02a-2a899230c84a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:50.348226 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-511d5502-c539-4525-b02a-2a899230c84a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:50.460029 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4a2de94f-bd9c-48c8-8d7a-0a18ab8ffbc3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:50.460635 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-4a2de94f-bd9c-48c8-8d7a-0a18ab8ffbc3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:50.466581 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a2de94f-bd9c-48c8-8d7a-0a18ab8ffbc3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:50.467059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a2de94f-bd9c-48c8-8d7a-0a18ab8ffbc3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:50.467821 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a2de94f-bd9c-48c8-8d7a-0a18ab8ffbc3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:50.468275 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a2de94f-bd9c-48c8-8d7a-0a18ab8ffbc3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:50.474474 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-511d5502-c539-4525-b02a-2a899230c84a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:50.481971 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-511d5502-c539-4525-b02a-2a899230c84a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.146498 Jun 20 18:46:50.482533 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 48/110] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:50 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:50.600728 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4a2de94f-bd9c-48c8-8d7a-0a18ab8ffbc3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:50.608521 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4a2de94f-bd9c-48c8-8d7a-0a18ab8ffbc3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.152365 Jun 20 18:46:50.609065 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 63/111] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:50 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:51.027550 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a1d7de07-d02b-4c35-affe-506811ef6d86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:51.028154 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a1d7de07-d02b-4c35-affe-506811ef6d86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:51.034694 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a1d7de07-d02b-4c35-affe-506811ef6d86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:51.035168 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a1d7de07-d02b-4c35-affe-506811ef6d86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:51.035919 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a1d7de07-d02b-4c35-affe-506811ef6d86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:51.036350 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a1d7de07-d02b-4c35-affe-506811ef6d86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:51.140288 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-962f471f-4945-4f66-9a94-28049b52d79a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:51.140899 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-962f471f-4945-4f66-9a94-28049b52d79a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:51.147317 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-962f471f-4945-4f66-9a94-28049b52d79a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:51.147761 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-962f471f-4945-4f66-9a94-28049b52d79a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:51.148521 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-962f471f-4945-4f66-9a94-28049b52d79a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:51.148954 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-962f471f-4945-4f66-9a94-28049b52d79a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:51.167518 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a1d7de07-d02b-4c35-affe-506811ef6d86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:51.175427 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a1d7de07-d02b-4c35-affe-506811ef6d86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:51.176929 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a1d7de07-d02b-4c35-affe-506811ef6d86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:51.178016 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a1d7de07-d02b-4c35-affe-506811ef6d86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.154292 Jun 20 18:46:51.178585 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 49/112] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:51 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:51.285830 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-962f471f-4945-4f66-9a94-28049b52d79a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:51.294035 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-962f471f-4945-4f66-9a94-28049b52d79a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.157577 Jun 20 18:46:51.294648 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 64/113] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:51 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:51.498871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-15d810e9-c779-45f7-bcd5-bb85d575f2e7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:51.499510 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-15d810e9-c779-45f7-bcd5-bb85d575f2e7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:51.505998 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-15d810e9-c779-45f7-bcd5-bb85d575f2e7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:51.506426 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-15d810e9-c779-45f7-bcd5-bb85d575f2e7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:51.507206 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-15d810e9-c779-45f7-bcd5-bb85d575f2e7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:51.507640 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-15d810e9-c779-45f7-bcd5-bb85d575f2e7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:51.511455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:51.625333 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-dcc8e0f1-1992-478e-b7ce-7f96e85239ab tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:51.626827 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-dcc8e0f1-1992-478e-b7ce-7f96e85239ab tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:51.632415 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dcc8e0f1-1992-478e-b7ce-7f96e85239ab tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:51.632867 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dcc8e0f1-1992-478e-b7ce-7f96e85239ab tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:51.633621 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dcc8e0f1-1992-478e-b7ce-7f96e85239ab tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:51.634053 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dcc8e0f1-1992-478e-b7ce-7f96e85239ab tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:51.646467 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-15d810e9-c779-45f7-bcd5-bb85d575f2e7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:51.654417 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-15d810e9-c779-45f7-bcd5-bb85d575f2e7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.159359 Jun 20 18:46:51.655199 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 50/114] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:51 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:51.768697 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-dcc8e0f1-1992-478e-b7ce-7f96e85239ab tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:51.776544 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-dcc8e0f1-1992-478e-b7ce-7f96e85239ab tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.155120 Jun 20 18:46:51.777100 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 65/115] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:51 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:52.197157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e733f80c-b21b-44dd-8677-0434ae8fa52c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:52.197884 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e733f80c-b21b-44dd-8677-0434ae8fa52c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:52.211605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e733f80c-b21b-44dd-8677-0434ae8fa52c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:52.212327 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e733f80c-b21b-44dd-8677-0434ae8fa52c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:52.213307 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e733f80c-b21b-44dd-8677-0434ae8fa52c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:52.214182 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e733f80c-b21b-44dd-8677-0434ae8fa52c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:52.325253 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e6b9e7ae-1b7b-4d92-84d0-ef151a3f497c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:52.326800 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e6b9e7ae-1b7b-4d92-84d0-ef151a3f497c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:52.342350 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e6b9e7ae-1b7b-4d92-84d0-ef151a3f497c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:52.342955 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e6b9e7ae-1b7b-4d92-84d0-ef151a3f497c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:52.344116 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e6b9e7ae-1b7b-4d92-84d0-ef151a3f497c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:52.344621 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e6b9e7ae-1b7b-4d92-84d0-ef151a3f497c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:52.418724 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e733f80c-b21b-44dd-8677-0434ae8fa52c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:52.427919 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e733f80c-b21b-44dd-8677-0434ae8fa52c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:52.430640 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e733f80c-b21b-44dd-8677-0434ae8fa52c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:52.432197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e733f80c-b21b-44dd-8677-0434ae8fa52c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.240053 Jun 20 18:46:52.444369 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 51/116] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:52 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:52.532441 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e6b9e7ae-1b7b-4d92-84d0-ef151a3f497c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:52.545805 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e6b9e7ae-1b7b-4d92-84d0-ef151a3f497c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.237762 Jun 20 18:46:52.546513 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 66/117] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:52 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:52.671615 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-188f9e6a-a06c-4f31-a4be-ec0c6faffae5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:52.672324 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-188f9e6a-a06c-4f31-a4be-ec0c6faffae5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:52.678852 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-188f9e6a-a06c-4f31-a4be-ec0c6faffae5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:52.679347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-188f9e6a-a06c-4f31-a4be-ec0c6faffae5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:52.680108 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-188f9e6a-a06c-4f31-a4be-ec0c6faffae5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:52.680545 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-188f9e6a-a06c-4f31-a4be-ec0c6faffae5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:52.794772 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b70bd747-0a97-4390-a1d3-cc7475425962 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:52.795472 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b70bd747-0a97-4390-a1d3-cc7475425962 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:52.802501 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b70bd747-0a97-4390-a1d3-cc7475425962 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:52.803197 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b70bd747-0a97-4390-a1d3-cc7475425962 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:52.804016 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b70bd747-0a97-4390-a1d3-cc7475425962 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:52.804643 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b70bd747-0a97-4390-a1d3-cc7475425962 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:52.825157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-188f9e6a-a06c-4f31-a4be-ec0c6faffae5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:52.859487 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-188f9e6a-a06c-4f31-a4be-ec0c6faffae5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.180446 Jun 20 18:46:52.862562 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 52/118] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:52 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:52.974309 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b70bd747-0a97-4390-a1d3-cc7475425962 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:52.982709 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b70bd747-0a97-4390-a1d3-cc7475425962 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.191841 Jun 20 18:46:52.983581 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 67/119] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:52 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:53.450283 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-df18cc13-8cb8-4ad0-87b8-8070a4d6a26d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:53.450925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-df18cc13-8cb8-4ad0-87b8-8070a4d6a26d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:53.457014 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-df18cc13-8cb8-4ad0-87b8-8070a4d6a26d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:53.457459 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-df18cc13-8cb8-4ad0-87b8-8070a4d6a26d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:53.458264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-df18cc13-8cb8-4ad0-87b8-8070a4d6a26d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:53.458709 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-df18cc13-8cb8-4ad0-87b8-8070a4d6a26d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:53.565059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-aeeda619-ecba-4961-bff2-87e778b46e99 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:53.566403 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-aeeda619-ecba-4961-bff2-87e778b46e99 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:53.580654 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-aeeda619-ecba-4961-bff2-87e778b46e99 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:53.581103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-aeeda619-ecba-4961-bff2-87e778b46e99 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:53.581866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-aeeda619-ecba-4961-bff2-87e778b46e99 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:53.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-aeeda619-ecba-4961-bff2-87e778b46e99 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:53.597954 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-df18cc13-8cb8-4ad0-87b8-8070a4d6a26d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:53.606929 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-df18cc13-8cb8-4ad0-87b8-8070a4d6a26d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:53.608617 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-df18cc13-8cb8-4ad0-87b8-8070a4d6a26d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:53.609836 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-df18cc13-8cb8-4ad0-87b8-8070a4d6a26d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.163412 Jun 20 18:46:53.614957 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 53/120] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:53 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:53.770688 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-aeeda619-ecba-4961-bff2-87e778b46e99 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:53.782098 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-aeeda619-ecba-4961-bff2-87e778b46e99 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.222503 Jun 20 18:46:53.783604 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 68/121] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:53 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:53.878171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8ef79009-92f8-4344-96ac-2289411f5c1f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:53.878800 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8ef79009-92f8-4344-96ac-2289411f5c1f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:53.885628 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8ef79009-92f8-4344-96ac-2289411f5c1f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:53.886120 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8ef79009-92f8-4344-96ac-2289411f5c1f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:53.886904 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8ef79009-92f8-4344-96ac-2289411f5c1f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:53.887364 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8ef79009-92f8-4344-96ac-2289411f5c1f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:54.003316 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-211a45ac-93d5-4d0a-a03e-02e533d3d1d0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:54.003954 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-211a45ac-93d5-4d0a-a03e-02e533d3d1d0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:54.011565 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-211a45ac-93d5-4d0a-a03e-02e533d3d1d0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:54.012161 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-211a45ac-93d5-4d0a-a03e-02e533d3d1d0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:54.012948 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-211a45ac-93d5-4d0a-a03e-02e533d3d1d0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:54.013557 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-211a45ac-93d5-4d0a-a03e-02e533d3d1d0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:54.035858 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8ef79009-92f8-4344-96ac-2289411f5c1f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:54.045523 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8ef79009-92f8-4344-96ac-2289411f5c1f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.171572 Jun 20 18:46:54.046400 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 54/122] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:53 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:54.154517 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-211a45ac-93d5-4d0a-a03e-02e533d3d1d0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:54.163397 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-211a45ac-93d5-4d0a-a03e-02e533d3d1d0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.165048 Jun 20 18:46:54.163961 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 69/123] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:53 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:54.631833 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-26de5510-8fe8-4341-862f-351bc2f704ab tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:54.632679 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-26de5510-8fe8-4341-862f-351bc2f704ab tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:54.642290 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-26de5510-8fe8-4341-862f-351bc2f704ab tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:54.642737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-26de5510-8fe8-4341-862f-351bc2f704ab tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:54.643544 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-26de5510-8fe8-4341-862f-351bc2f704ab tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:54.643978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-26de5510-8fe8-4341-862f-351bc2f704ab tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:54.802803 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-11397450-2043-4389-ba4a-d635f345729c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:54.804535 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-11397450-2043-4389-ba4a-d635f345729c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:54.814634 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11397450-2043-4389-ba4a-d635f345729c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:54.815469 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11397450-2043-4389-ba4a-d635f345729c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:54.816758 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11397450-2043-4389-ba4a-d635f345729c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:54.817457 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11397450-2043-4389-ba4a-d635f345729c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:54.852671 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-26de5510-8fe8-4341-862f-351bc2f704ab tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:54.862884 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-26de5510-8fe8-4341-862f-351bc2f704ab tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:54.866690 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-26de5510-8fe8-4341-862f-351bc2f704ab tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:54.868352 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-26de5510-8fe8-4341-862f-351bc2f704ab tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.243698 Jun 20 18:46:54.881702 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 55/124] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:54 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:54.963134 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-11397450-2043-4389-ba4a-d635f345729c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:54.970591 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-11397450-2043-4389-ba4a-d635f345729c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.173887 Jun 20 18:46:54.971184 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 70/125] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:54 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:55.064790 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-800c1374-1202-4f7a-b32c-1f3326aface4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:55.065473 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-800c1374-1202-4f7a-b32c-1f3326aface4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:55.073085 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-800c1374-1202-4f7a-b32c-1f3326aface4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:55.073992 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-800c1374-1202-4f7a-b32c-1f3326aface4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:55.075604 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-800c1374-1202-4f7a-b32c-1f3326aface4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:55.076147 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-800c1374-1202-4f7a-b32c-1f3326aface4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:55.183532 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ec47906a-d1a4-458b-8e74-833136d468cb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:55.184898 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ec47906a-d1a4-458b-8e74-833136d468cb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:55.192369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ec47906a-d1a4-458b-8e74-833136d468cb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:55.192823 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ec47906a-d1a4-458b-8e74-833136d468cb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:55.193626 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ec47906a-d1a4-458b-8e74-833136d468cb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:55.194028 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ec47906a-d1a4-458b-8e74-833136d468cb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:55.221707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-800c1374-1202-4f7a-b32c-1f3326aface4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:55.230000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-800c1374-1202-4f7a-b32c-1f3326aface4 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.169748 Jun 20 18:46:55.230573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 56/126] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:55 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:55.345634 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ec47906a-d1a4-458b-8e74-833136d468cb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:55.353841 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ec47906a-d1a4-458b-8e74-833136d468cb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.176158 Jun 20 18:46:55.354400 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 71/127] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:55 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:55.478740 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-a5d08693-63f1-4999-ba78-ff42cb270185 req-27e46343-41f8-4a43-b41f-a0c5e5218c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa52c387-5b77-4644-85c8-691b22dfeb78", "name": "network-vif-plugged", "status": "completed", "tag": "920abf72-084f-4d4e-be79-106c82668c67"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:46:55.489624 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-a5d08693-63f1-4999-ba78-ff42cb270185 req-27e46343-41f8-4a43-b41f-a0c5e5218c75 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:55.490059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-a5d08693-63f1-4999-ba78-ff42cb270185 req-27e46343-41f8-4a43-b41f-a0c5e5218c75 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:55.508615 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-a5d08693-63f1-4999-ba78-ff42cb270185 req-27e46343-41f8-4a43-b41f-a0c5e5218c75 service nova] Creating event network-vif-plugged:920abf72-084f-4d4e-be79-106c82668c67 for instance aa52c387-5b77-4644-85c8-691b22dfeb78 on hv-cinder-83697 Jun 20 18:46:55.509123 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-a5d08693-63f1-4999-ba78-ff42cb270185 req-27e46343-41f8-4a43-b41f-a0c5e5218c75 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124189) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 18:46:55.510167 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e74e8dab-0ee9-441e-bca8-9d236b140393 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:55.510599 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e74e8dab-0ee9-441e-bca8-9d236b140393 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:55.511412 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e74e8dab-0ee9-441e-bca8-9d236b140393 None None] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:55.511834 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e74e8dab-0ee9-441e-bca8-9d236b140393 None None] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:55.521134 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.compute.rpcapi [None req-e74e8dab-0ee9-441e-bca8-9d236b140393 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 18:46:55.522034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e74e8dab-0ee9-441e-bca8-9d236b140393 None None] Releasing lock "compute-rpcapi-router" {{(pid=124189) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 18:46:55.537812 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e74e8dab-0ee9-441e-bca8-9d236b140393 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118880 Jun 20 18:46:55.538398 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 57/128] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:55.889890 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-83a586ce-1610-4430-a060-df5f692bd981 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:55.891541 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-83a586ce-1610-4430-a060-df5f692bd981 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:55.911276 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-83a586ce-1610-4430-a060-df5f692bd981 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:55.911731 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-83a586ce-1610-4430-a060-df5f692bd981 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:55.912872 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-83a586ce-1610-4430-a060-df5f692bd981 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:55.913313 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-83a586ce-1610-4430-a060-df5f692bd981 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:55.999311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d8b7ecca-9129-4e59-b0c0-9a7cfb8816b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:56.000060 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d8b7ecca-9129-4e59-b0c0-9a7cfb8816b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:56.017128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d8b7ecca-9129-4e59-b0c0-9a7cfb8816b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:56.017784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d8b7ecca-9129-4e59-b0c0-9a7cfb8816b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:56.019034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d8b7ecca-9129-4e59-b0c0-9a7cfb8816b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:56.019793 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d8b7ecca-9129-4e59-b0c0-9a7cfb8816b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:56.089998 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-83a586ce-1610-4430-a060-df5f692bd981 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:56.107124 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-83a586ce-1610-4430-a060-df5f692bd981 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:56.109123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-83a586ce-1610-4430-a060-df5f692bd981 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:56.110729 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-83a586ce-1610-4430-a060-df5f692bd981 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.225251 Jun 20 18:46:56.112149 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 72/129] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:55 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:56.204558 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d8b7ecca-9129-4e59-b0c0-9a7cfb8816b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:56.213332 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d8b7ecca-9129-4e59-b0c0-9a7cfb8816b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.229139 Jun 20 18:46:56.224180 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 58/130] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:55 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:56.247109 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e6c4531f-b013-4be3-a295-e26fb9b88065 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:56.247713 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e6c4531f-b013-4be3-a295-e26fb9b88065 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:56.254224 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e6c4531f-b013-4be3-a295-e26fb9b88065 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:56.254668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e6c4531f-b013-4be3-a295-e26fb9b88065 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:56.255454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e6c4531f-b013-4be3-a295-e26fb9b88065 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:56.255896 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e6c4531f-b013-4be3-a295-e26fb9b88065 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:56.259870 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=100 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:56.370330 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-236db40b-ad74-49b3-b33c-7101b4efc8d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:56.370961 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-236db40b-ad74-49b3-b33c-7101b4efc8d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:56.377405 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-236db40b-ad74-49b3-b33c-7101b4efc8d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:56.377837 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-236db40b-ad74-49b3-b33c-7101b4efc8d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:56.378622 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-236db40b-ad74-49b3-b33c-7101b4efc8d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:56.379053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-236db40b-ad74-49b3-b33c-7101b4efc8d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:56.417991 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e6c4531f-b013-4be3-a295-e26fb9b88065 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:56.432239 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e6c4531f-b013-4be3-a295-e26fb9b88065 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.188649 Jun 20 18:46:56.433133 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 73/131] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:56 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:56.568427 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-236db40b-ad74-49b3-b33c-7101b4efc8d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:56.577101 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-236db40b-ad74-49b3-b33c-7101b4efc8d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.210613 Jun 20 18:46:56.585189 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 59/132] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:56 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:57.130373 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a5bb6832-8720-43e9-a603-500db098fc39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:57.131015 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a5bb6832-8720-43e9-a603-500db098fc39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:57.137083 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a5bb6832-8720-43e9-a603-500db098fc39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:57.137533 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a5bb6832-8720-43e9-a603-500db098fc39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:57.138299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a5bb6832-8720-43e9-a603-500db098fc39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:57.138729 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a5bb6832-8720-43e9-a603-500db098fc39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:57.235096 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-59285895-86af-4064-a85d-305470e15a15 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:57.237336 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-59285895-86af-4064-a85d-305470e15a15 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:57.244695 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-59285895-86af-4064-a85d-305470e15a15 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:57.245326 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-59285895-86af-4064-a85d-305470e15a15 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:57.246169 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-59285895-86af-4064-a85d-305470e15a15 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:57.247355 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-59285895-86af-4064-a85d-305470e15a15 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:57.336444 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a5bb6832-8720-43e9-a603-500db098fc39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:57.344516 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a5bb6832-8720-43e9-a603-500db098fc39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:57.346051 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a5bb6832-8720-43e9-a603-500db098fc39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:57.348164 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a5bb6832-8720-43e9-a603-500db098fc39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.222459 Jun 20 18:46:57.348893 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 74/133] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:57 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:46:57.450617 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a2521c91-7992-4f98-9fcf-a305b2aae767 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:57.451661 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a2521c91-7992-4f98-9fcf-a305b2aae767 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:57.462350 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a2521c91-7992-4f98-9fcf-a305b2aae767 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:57.465422 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a2521c91-7992-4f98-9fcf-a305b2aae767 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:57.466570 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a2521c91-7992-4f98-9fcf-a305b2aae767 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:57.467351 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a2521c91-7992-4f98-9fcf-a305b2aae767 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:57.660995 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-59285895-86af-4064-a85d-305470e15a15 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:57.671799 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-59285895-86af-4064-a85d-305470e15a15 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.444371 Jun 20 18:46:57.682268 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 60/134] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:57 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:46:57.699084 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-6548a8a0-8556-4fcd-bb1f-dbdeb967b2a0 req-410d2540-3c30-4492-a310-3d1855a30180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2614c08f-0c19-4066-8c87-551d4ac2f725", "name": "network-vif-plugged", "status": "completed", "tag": "ffa2211c-05a6-4fea-b138-2d18f0a69e0b"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:46:57.708720 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-6548a8a0-8556-4fcd-bb1f-dbdeb967b2a0 req-410d2540-3c30-4492-a310-3d1855a30180 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:57.709197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-6548a8a0-8556-4fcd-bb1f-dbdeb967b2a0 req-410d2540-3c30-4492-a310-3d1855a30180 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:57.739844 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-6548a8a0-8556-4fcd-bb1f-dbdeb967b2a0 req-410d2540-3c30-4492-a310-3d1855a30180 service nova] Creating event network-vif-plugged:ffa2211c-05a6-4fea-b138-2d18f0a69e0b for instance 2614c08f-0c19-4066-8c87-551d4ac2f725 on hv-cinder-83697 Jun 20 18:46:57.750872 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-6548a8a0-8556-4fcd-bb1f-dbdeb967b2a0 req-410d2540-3c30-4492-a310-3d1855a30180 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065764 Jun 20 18:46:57.759673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 61/135] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:46:57.765119 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3b6f359e-b137-4196-bbf4-3220d6fc87f0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:57.765977 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-3b6f359e-b137-4196-bbf4-3220d6fc87f0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:57.780503 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3b6f359e-b137-4196-bbf4-3220d6fc87f0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:57.785699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3b6f359e-b137-4196-bbf4-3220d6fc87f0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:57.786738 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3b6f359e-b137-4196-bbf4-3220d6fc87f0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:57.787505 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3b6f359e-b137-4196-bbf4-3220d6fc87f0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:58.073736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a2521c91-7992-4f98-9fcf-a305b2aae767 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:58.081554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a2521c91-7992-4f98-9fcf-a305b2aae767 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.636005 Jun 20 18:46:58.082895 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 75/136] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:57 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:58.367400 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-002406a7-bc16-4980-bc7a-da88bef8ee94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:58.367995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-002406a7-bc16-4980-bc7a-da88bef8ee94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:58.375462 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-002406a7-bc16-4980-bc7a-da88bef8ee94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:58.376772 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-002406a7-bc16-4980-bc7a-da88bef8ee94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:58.377834 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-002406a7-bc16-4980-bc7a-da88bef8ee94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:58.378447 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-002406a7-bc16-4980-bc7a-da88bef8ee94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:58.497620 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-3b6f359e-b137-4196-bbf4-3220d6fc87f0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:58.508259 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-3b6f359e-b137-4196-bbf4-3220d6fc87f0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.747242 Jun 20 18:46:58.509279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 62/137] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:57 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:58.682168 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-002406a7-bc16-4980-bc7a-da88bef8ee94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:58.689285 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0ea1426c-4fc0-49ba-8c70-721cce947064 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:58.689894 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0ea1426c-4fc0-49ba-8c70-721cce947064 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:58.695547 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-002406a7-bc16-4980-bc7a-da88bef8ee94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:58.697885 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-002406a7-bc16-4980-bc7a-da88bef8ee94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:58.700158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-002406a7-bc16-4980-bc7a-da88bef8ee94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.335758 Jun 20 18:46:58.701682 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 76/138] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:58 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:46:58.707411 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ea1426c-4fc0-49ba-8c70-721cce947064 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:58.707411 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ea1426c-4fc0-49ba-8c70-721cce947064 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:58.707570 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ea1426c-4fc0-49ba-8c70-721cce947064 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:58.707964 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ea1426c-4fc0-49ba-8c70-721cce947064 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:58.861540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0ea1426c-4fc0-49ba-8c70-721cce947064 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:58.869060 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0ea1426c-4fc0-49ba-8c70-721cce947064 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.184312 Jun 20 18:46:58.869791 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 63/139] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:58 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:59.098965 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9cca4235-116c-4b26-afc9-3cfe121e136e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:59.099989 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9cca4235-116c-4b26-afc9-3cfe121e136e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:59.106535 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9cca4235-116c-4b26-afc9-3cfe121e136e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:59.107096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9cca4235-116c-4b26-afc9-3cfe121e136e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:59.108044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9cca4235-116c-4b26-afc9-3cfe121e136e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:59.108437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9cca4235-116c-4b26-afc9-3cfe121e136e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:59.250250 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9cca4235-116c-4b26-afc9-3cfe121e136e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:59.259343 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9cca4235-116c-4b26-afc9-3cfe121e136e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.163796 Jun 20 18:46:59.260237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 77/140] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:59 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:59.529856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7a377875-90f4-4ae5-bafb-77162b7ce5d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:59.531217 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7a377875-90f4-4ae5-bafb-77162b7ce5d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:59.543416 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7a377875-90f4-4ae5-bafb-77162b7ce5d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:59.544078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7a377875-90f4-4ae5-bafb-77162b7ce5d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:59.545018 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7a377875-90f4-4ae5-bafb-77162b7ce5d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:59.545855 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7a377875-90f4-4ae5-bafb-77162b7ce5d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:59.709638 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7a377875-90f4-4ae5-bafb-77162b7ce5d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:59.722660 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-bd39832b-6250-425f-af7d-9107469a4c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:59.723870 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-bd39832b-6250-425f-af7d-9107469a4c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:59.730089 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bd39832b-6250-425f-af7d-9107469a4c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:59.731327 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bd39832b-6250-425f-af7d-9107469a4c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:59.734894 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7a377875-90f4-4ae5-bafb-77162b7ce5d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.213104 Jun 20 18:46:59.736199 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 64/141] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:59 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:46:59.739320 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bd39832b-6250-425f-af7d-9107469a4c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:59.739928 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bd39832b-6250-425f-af7d-9107469a4c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:59.882804 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-bd39832b-6250-425f-af7d-9107469a4c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:59.887783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-91be4a31-1c8d-4c46-b92f-33ea93dd4a21 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:46:59.888388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-91be4a31-1c8d-4c46-b92f-33ea93dd4a21 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:46:59.897737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91be4a31-1c8d-4c46-b92f-33ea93dd4a21 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:59.898692 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91be4a31-1c8d-4c46-b92f-33ea93dd4a21 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:59.899219 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-bd39832b-6250-425f-af7d-9107469a4c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:59.899918 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91be4a31-1c8d-4c46-b92f-33ea93dd4a21 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:46:59.900663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91be4a31-1c8d-4c46-b92f-33ea93dd4a21 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:46:59.901812 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-bd39832b-6250-425f-af7d-9107469a4c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:46:59.904078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-bd39832b-6250-425f-af7d-9107469a4c27 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.186222 Jun 20 18:46:59.904793 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 78/142] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:46:59 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:47:00.064365 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-91be4a31-1c8d-4c46-b92f-33ea93dd4a21 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:00.081383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-91be4a31-1c8d-4c46-b92f-33ea93dd4a21 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.197236 Jun 20 18:47:00.082222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 65/143] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:46:59 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:00.275890 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-47b361ed-91d0-4fce-99fb-834127328476 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:00.276750 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-47b361ed-91d0-4fce-99fb-834127328476 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:00.283459 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-47b361ed-91d0-4fce-99fb-834127328476 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:00.283893 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-47b361ed-91d0-4fce-99fb-834127328476 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:00.284842 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-47b361ed-91d0-4fce-99fb-834127328476 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:00.285272 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-47b361ed-91d0-4fce-99fb-834127328476 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:00.443565 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-47b361ed-91d0-4fce-99fb-834127328476 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:00.453362 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-47b361ed-91d0-4fce-99fb-834127328476 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.181047 Jun 20 18:47:00.455026 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 79/144] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:00 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:00.752814 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3fde8a64-341f-4ab9-9f60-c7e816d50d79 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:00.753419 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-3fde8a64-341f-4ab9-9f60-c7e816d50d79 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:00.759407 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3fde8a64-341f-4ab9-9f60-c7e816d50d79 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:00.759848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3fde8a64-341f-4ab9-9f60-c7e816d50d79 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:00.760597 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3fde8a64-341f-4ab9-9f60-c7e816d50d79 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:00.761022 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3fde8a64-341f-4ab9-9f60-c7e816d50d79 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:00.903153 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-3fde8a64-341f-4ab9-9f60-c7e816d50d79 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:00.912315 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-3fde8a64-341f-4ab9-9f60-c7e816d50d79 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.163432 Jun 20 18:47:00.912887 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 66/145] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:00 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:00.925909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ebdb7698-4f0b-4b74-b455-ced9a48d090f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:00.926522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ebdb7698-4f0b-4b74-b455-ced9a48d090f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:00.933763 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ebdb7698-4f0b-4b74-b455-ced9a48d090f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:00.934618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ebdb7698-4f0b-4b74-b455-ced9a48d090f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:00.935777 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ebdb7698-4f0b-4b74-b455-ced9a48d090f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:00.936225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ebdb7698-4f0b-4b74-b455-ced9a48d090f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:01.105402 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0a3facde-3b51-4157-bd12-4cebaa298f34 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:01.106159 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0a3facde-3b51-4157-bd12-4cebaa298f34 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:01.108334 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ebdb7698-4f0b-4b74-b455-ced9a48d090f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:01.116333 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0a3facde-3b51-4157-bd12-4cebaa298f34 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:01.116782 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0a3facde-3b51-4157-bd12-4cebaa298f34 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:01.117433 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ebdb7698-4f0b-4b74-b455-ced9a48d090f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:01.117810 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0a3facde-3b51-4157-bd12-4cebaa298f34 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:01.118247 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0a3facde-3b51-4157-bd12-4cebaa298f34 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:01.118970 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ebdb7698-4f0b-4b74-b455-ced9a48d090f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:01.120512 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ebdb7698-4f0b-4b74-b455-ced9a48d090f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.201224 Jun 20 18:47:01.121071 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 80/146] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:47:00 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:47:01.326189 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0a3facde-3b51-4157-bd12-4cebaa298f34 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:01.330032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:01.334724 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0a3facde-3b51-4157-bd12-4cebaa298f34 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.233991 Jun 20 18:47:01.335950 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 67/147] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:01 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:01.477549 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-34e93fa7-1aa6-4ee3-b000-c93617ac1bfa tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:01.479650 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-34e93fa7-1aa6-4ee3-b000-c93617ac1bfa tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:01.486772 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-34e93fa7-1aa6-4ee3-b000-c93617ac1bfa tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:01.487242 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-34e93fa7-1aa6-4ee3-b000-c93617ac1bfa tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:01.488282 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-34e93fa7-1aa6-4ee3-b000-c93617ac1bfa tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:01.488590 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-34e93fa7-1aa6-4ee3-b000-c93617ac1bfa tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:01.617862 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-34e93fa7-1aa6-4ee3-b000-c93617ac1bfa tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:01.626279 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-34e93fa7-1aa6-4ee3-b000-c93617ac1bfa tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.156954 Jun 20 18:47:01.626934 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 81/148] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:01 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:47:01.929599 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-95211d6e-f1ac-4b15-b6d8-6cb0fbf36998 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:01.930163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-95211d6e-f1ac-4b15-b6d8-6cb0fbf36998 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:01.936283 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-95211d6e-f1ac-4b15-b6d8-6cb0fbf36998 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:01.936721 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-95211d6e-f1ac-4b15-b6d8-6cb0fbf36998 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:01.937461 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-95211d6e-f1ac-4b15-b6d8-6cb0fbf36998 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:01.937883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-95211d6e-f1ac-4b15-b6d8-6cb0fbf36998 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:02.062629 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-95211d6e-f1ac-4b15-b6d8-6cb0fbf36998 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:02.070491 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-95211d6e-f1ac-4b15-b6d8-6cb0fbf36998 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.145192 Jun 20 18:47:02.071064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 68/149] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:01 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:02.140082 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-456655ad-7c4b-47c1-b60e-69e9516f2e86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:02.140686 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-456655ad-7c4b-47c1-b60e-69e9516f2e86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:02.147340 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-456655ad-7c4b-47c1-b60e-69e9516f2e86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:02.147787 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-456655ad-7c4b-47c1-b60e-69e9516f2e86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:02.148539 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-456655ad-7c4b-47c1-b60e-69e9516f2e86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:02.148970 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-456655ad-7c4b-47c1-b60e-69e9516f2e86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:02.271643 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-456655ad-7c4b-47c1-b60e-69e9516f2e86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:02.279409 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-456655ad-7c4b-47c1-b60e-69e9516f2e86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:02.280935 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-456655ad-7c4b-47c1-b60e-69e9516f2e86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:02.282039 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-456655ad-7c4b-47c1-b60e-69e9516f2e86 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.145801 Jun 20 18:47:02.282654 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 82/150] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:47:02 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:47:02.351980 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0ff81d9b-4acb-42ea-b3e1-140a0a7ea283 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:02.352664 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0ff81d9b-4acb-42ea-b3e1-140a0a7ea283 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:02.358688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ff81d9b-4acb-42ea-b3e1-140a0a7ea283 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:02.359167 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ff81d9b-4acb-42ea-b3e1-140a0a7ea283 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:02.359920 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ff81d9b-4acb-42ea-b3e1-140a0a7ea283 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:02.360853 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ff81d9b-4acb-42ea-b3e1-140a0a7ea283 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:02.487636 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0ff81d9b-4acb-42ea-b3e1-140a0a7ea283 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:02.495000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0ff81d9b-4acb-42ea-b3e1-140a0a7ea283 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.146913 Jun 20 18:47:02.495550 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 69/151] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:02 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:02.643631 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-11fb1521-67a4-402d-89e6-591e3c84673f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:02.644233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-11fb1521-67a4-402d-89e6-591e3c84673f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:02.650112 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11fb1521-67a4-402d-89e6-591e3c84673f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:02.650743 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11fb1521-67a4-402d-89e6-591e3c84673f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:02.651528 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11fb1521-67a4-402d-89e6-591e3c84673f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:02.651959 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11fb1521-67a4-402d-89e6-591e3c84673f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:02.785619 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-11fb1521-67a4-402d-89e6-591e3c84673f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:02.793124 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-11fb1521-67a4-402d-89e6-591e3c84673f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.154025 Jun 20 18:47:02.793674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 83/152] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:02 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:03.087808 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-de34bc75-c4a7-4d47-aa29-cf2c7fa0cc1d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:03.088305 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-de34bc75-c4a7-4d47-aa29-cf2c7fa0cc1d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:03.094296 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-de34bc75-c4a7-4d47-aa29-cf2c7fa0cc1d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:03.095362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-de34bc75-c4a7-4d47-aa29-cf2c7fa0cc1d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:03.096119 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-de34bc75-c4a7-4d47-aa29-cf2c7fa0cc1d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:03.096548 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-de34bc75-c4a7-4d47-aa29-cf2c7fa0cc1d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:03.225371 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-de34bc75-c4a7-4d47-aa29-cf2c7fa0cc1d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:03.232705 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-de34bc75-c4a7-4d47-aa29-cf2c7fa0cc1d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.148840 Jun 20 18:47:03.233254 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 70/153] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:03 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:03.299832 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b5d79012-e203-4f42-9a34-9fdf0f910355 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:03.300556 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b5d79012-e203-4f42-9a34-9fdf0f910355 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:03.302387 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=95 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:03.307518 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b5d79012-e203-4f42-9a34-9fdf0f910355 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:03.307962 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b5d79012-e203-4f42-9a34-9fdf0f910355 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:03.308716 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b5d79012-e203-4f42-9a34-9fdf0f910355 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:03.309146 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b5d79012-e203-4f42-9a34-9fdf0f910355 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:03.433549 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b5d79012-e203-4f42-9a34-9fdf0f910355 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:03.441521 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b5d79012-e203-4f42-9a34-9fdf0f910355 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:03.443049 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b5d79012-e203-4f42-9a34-9fdf0f910355 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:03.444150 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b5d79012-e203-4f42-9a34-9fdf0f910355 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.148137 Jun 20 18:47:03.444719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 84/154] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:47:03 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:47:03.511744 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d8002276-a727-4076-a21a-cddb1747df7f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:03.512344 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d8002276-a727-4076-a21a-cddb1747df7f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:03.518726 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d8002276-a727-4076-a21a-cddb1747df7f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:03.519225 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d8002276-a727-4076-a21a-cddb1747df7f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:03.519981 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d8002276-a727-4076-a21a-cddb1747df7f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:03.520538 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d8002276-a727-4076-a21a-cddb1747df7f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:03.648440 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d8002276-a727-4076-a21a-cddb1747df7f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:03.655768 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d8002276-a727-4076-a21a-cddb1747df7f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.147805 Jun 20 18:47:03.656322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 71/155] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:03 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:03.810764 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-df3a9a71-2e78-4a73-9655-e9f3cfb3f414 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:03.811653 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-df3a9a71-2e78-4a73-9655-e9f3cfb3f414 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:03.818178 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-df3a9a71-2e78-4a73-9655-e9f3cfb3f414 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:03.818628 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-df3a9a71-2e78-4a73-9655-e9f3cfb3f414 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:03.819423 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-df3a9a71-2e78-4a73-9655-e9f3cfb3f414 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:03.819855 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-df3a9a71-2e78-4a73-9655-e9f3cfb3f414 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:03.955857 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-df3a9a71-2e78-4a73-9655-e9f3cfb3f414 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:03.963467 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-df3a9a71-2e78-4a73-9655-e9f3cfb3f414 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.157575 Jun 20 18:47:03.964025 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 85/156] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:03 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:04.249119 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fe1da831-0237-4531-94c9-1318ab3b4980 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:04.249852 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fe1da831-0237-4531-94c9-1318ab3b4980 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:04.256041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fe1da831-0237-4531-94c9-1318ab3b4980 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:04.256553 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fe1da831-0237-4531-94c9-1318ab3b4980 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:04.257368 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fe1da831-0237-4531-94c9-1318ab3b4980 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:04.257861 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fe1da831-0237-4531-94c9-1318ab3b4980 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:04.392595 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fe1da831-0237-4531-94c9-1318ab3b4980 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:04.402257 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fe1da831-0237-4531-94c9-1318ab3b4980 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.156782 Jun 20 18:47:04.402938 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 72/157] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:04 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:47:04.461775 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-eb0472d0-d732-4d5b-b40d-56a44bc1ba9d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:04.462448 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-eb0472d0-d732-4d5b-b40d-56a44bc1ba9d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:04.469817 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-eb0472d0-d732-4d5b-b40d-56a44bc1ba9d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:04.470328 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-eb0472d0-d732-4d5b-b40d-56a44bc1ba9d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:04.471360 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-eb0472d0-d732-4d5b-b40d-56a44bc1ba9d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:04.471858 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-eb0472d0-d732-4d5b-b40d-56a44bc1ba9d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:04.626466 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-eb0472d0-d732-4d5b-b40d-56a44bc1ba9d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:04.634613 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-eb0472d0-d732-4d5b-b40d-56a44bc1ba9d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:04.636145 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-eb0472d0-d732-4d5b-b40d-56a44bc1ba9d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:04.637740 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-eb0472d0-d732-4d5b-b40d-56a44bc1ba9d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.179476 Jun 20 18:47:04.647410 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 86/158] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:47:04 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:47:04.674846 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-949abe68-fd6a-40a0-a5c0-faa0f00a7462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:04.675637 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-949abe68-fd6a-40a0-a5c0-faa0f00a7462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:04.682451 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-949abe68-fd6a-40a0-a5c0-faa0f00a7462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:04.683291 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-949abe68-fd6a-40a0-a5c0-faa0f00a7462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:04.684239 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-949abe68-fd6a-40a0-a5c0-faa0f00a7462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:04.684750 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-949abe68-fd6a-40a0-a5c0-faa0f00a7462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:04.820492 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-949abe68-fd6a-40a0-a5c0-faa0f00a7462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:04.827900 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-949abe68-fd6a-40a0-a5c0-faa0f00a7462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.157857 Jun 20 18:47:04.828503 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 73/159] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:04 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:04.980598 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5c96e4f9-6ff6-49d8-b7ba-13d9a9a70dd5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:04.981198 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5c96e4f9-6ff6-49d8-b7ba-13d9a9a70dd5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:04.987781 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5c96e4f9-6ff6-49d8-b7ba-13d9a9a70dd5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:04.988206 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5c96e4f9-6ff6-49d8-b7ba-13d9a9a70dd5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:04.988948 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5c96e4f9-6ff6-49d8-b7ba-13d9a9a70dd5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:04.989384 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5c96e4f9-6ff6-49d8-b7ba-13d9a9a70dd5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:05.133400 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5c96e4f9-6ff6-49d8-b7ba-13d9a9a70dd5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:05.142281 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5c96e4f9-6ff6-49d8-b7ba-13d9a9a70dd5 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.164926 Jun 20 18:47:05.142991 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 87/160] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:04 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:05.418594 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-44cd67fd-58f3-47d2-a199-08d4c98d8f1e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:05.419240 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-44cd67fd-58f3-47d2-a199-08d4c98d8f1e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:05.425101 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44cd67fd-58f3-47d2-a199-08d4c98d8f1e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:05.425545 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44cd67fd-58f3-47d2-a199-08d4c98d8f1e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:05.426297 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44cd67fd-58f3-47d2-a199-08d4c98d8f1e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:05.426727 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44cd67fd-58f3-47d2-a199-08d4c98d8f1e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:05.519389 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:05.554932 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-44cd67fd-58f3-47d2-a199-08d4c98d8f1e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:05.562076 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-44cd67fd-58f3-47d2-a199-08d4c98d8f1e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.147274 Jun 20 18:47:05.562621 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 74/161] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:05 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:05.656003 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6c5c7788-2c23-4e87-839f-dc78a32b94da tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:05.656695 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6c5c7788-2c23-4e87-839f-dc78a32b94da tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:05.663664 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6c5c7788-2c23-4e87-839f-dc78a32b94da tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:05.664177 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6c5c7788-2c23-4e87-839f-dc78a32b94da tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:05.665005 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6c5c7788-2c23-4e87-839f-dc78a32b94da tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:05.665465 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6c5c7788-2c23-4e87-839f-dc78a32b94da tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:05.829039 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6c5c7788-2c23-4e87-839f-dc78a32b94da tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:05.837976 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6c5c7788-2c23-4e87-839f-dc78a32b94da tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:05.839702 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6c5c7788-2c23-4e87-839f-dc78a32b94da tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:05.846248 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f8008172-3447-42b7-8a96-2143b4ddd1f2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:05.847074 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f8008172-3447-42b7-8a96-2143b4ddd1f2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:05.852469 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6c5c7788-2c23-4e87-839f-dc78a32b94da tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.200926 Jun 20 18:47:05.853035 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 88/162] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:47:05 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:47:05.856354 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f8008172-3447-42b7-8a96-2143b4ddd1f2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:05.856959 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f8008172-3447-42b7-8a96-2143b4ddd1f2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:05.857837 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f8008172-3447-42b7-8a96-2143b4ddd1f2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:05.858473 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f8008172-3447-42b7-8a96-2143b4ddd1f2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:05.996078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f8008172-3447-42b7-8a96-2143b4ddd1f2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:06.005109 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f8008172-3447-42b7-8a96-2143b4ddd1f2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.163171 Jun 20 18:47:06.005675 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 75/163] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:05 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:06.160546 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a053d840-fbd6-4b64-ae9f-e27dcade62d0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:06.161165 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a053d840-fbd6-4b64-ae9f-e27dcade62d0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:06.169397 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a053d840-fbd6-4b64-ae9f-e27dcade62d0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:06.169850 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a053d840-fbd6-4b64-ae9f-e27dcade62d0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:06.170614 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a053d840-fbd6-4b64-ae9f-e27dcade62d0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:06.171305 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a053d840-fbd6-4b64-ae9f-e27dcade62d0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:06.332198 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a053d840-fbd6-4b64-ae9f-e27dcade62d0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:06.336338 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=100 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:06.342115 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a053d840-fbd6-4b64-ae9f-e27dcade62d0 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.186353 Jun 20 18:47:06.343010 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 89/164] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:06 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:06.467023 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-6f5fbe1b-718d-4219-a3ef-01aa4e7eb7ab req-ed44c2cf-2503-40bc-bf64-da470fe69bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1fde39e-3570-4635-a3c3-b3aea5abf190", "name": "network-vif-plugged", "status": "completed", "tag": "afba41a9-6713-4c38-829a-4c3d915f0d01"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:47:06.476231 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-6f5fbe1b-718d-4219-a3ef-01aa4e7eb7ab req-ed44c2cf-2503-40bc-bf64-da470fe69bff service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:06.477283 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-6f5fbe1b-718d-4219-a3ef-01aa4e7eb7ab req-ed44c2cf-2503-40bc-bf64-da470fe69bff service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:06.492358 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-6f5fbe1b-718d-4219-a3ef-01aa4e7eb7ab req-ed44c2cf-2503-40bc-bf64-da470fe69bff service nova] Creating event network-vif-plugged:afba41a9-6713-4c38-829a-4c3d915f0d01 for instance b1fde39e-3570-4635-a3c3-b3aea5abf190 on hv-cinder-83697 Jun 20 18:47:06.500508 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-6f5fbe1b-718d-4219-a3ef-01aa4e7eb7ab req-ed44c2cf-2503-40bc-bf64-da470fe69bff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037945 Jun 20 18:47:06.501625 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 76/165] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:47:06.579106 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-464164cb-4ef7-4321-9466-5aa79e51ac98 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:06.579709 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-464164cb-4ef7-4321-9466-5aa79e51ac98 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:06.585840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-464164cb-4ef7-4321-9466-5aa79e51ac98 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:06.586514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-464164cb-4ef7-4321-9466-5aa79e51ac98 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:06.587425 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-464164cb-4ef7-4321-9466-5aa79e51ac98 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:06.587918 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-464164cb-4ef7-4321-9466-5aa79e51ac98 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:06.729947 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-464164cb-4ef7-4321-9466-5aa79e51ac98 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:06.738390 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-464164cb-4ef7-4321-9466-5aa79e51ac98 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.163140 Jun 20 18:47:06.738984 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 90/166] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:06 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:06.870793 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9fabbdb4-1a0d-4c1c-82d7-8072a8a69d53 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:06.871536 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9fabbdb4-1a0d-4c1c-82d7-8072a8a69d53 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:06.878302 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9fabbdb4-1a0d-4c1c-82d7-8072a8a69d53 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:06.878748 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9fabbdb4-1a0d-4c1c-82d7-8072a8a69d53 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:06.879535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9fabbdb4-1a0d-4c1c-82d7-8072a8a69d53 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:06.879969 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9fabbdb4-1a0d-4c1c-82d7-8072a8a69d53 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:07.021375 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-cb746bf4-3a6c-4ba3-92f8-53bd3735b1d7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:07.022131 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-cb746bf4-3a6c-4ba3-92f8-53bd3735b1d7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:07.031377 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cb746bf4-3a6c-4ba3-92f8-53bd3735b1d7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:07.031826 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cb746bf4-3a6c-4ba3-92f8-53bd3735b1d7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:07.032810 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cb746bf4-3a6c-4ba3-92f8-53bd3735b1d7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:07.034894 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cb746bf4-3a6c-4ba3-92f8-53bd3735b1d7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:07.052896 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9fabbdb4-1a0d-4c1c-82d7-8072a8a69d53 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:07.071421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9fabbdb4-1a0d-4c1c-82d7-8072a8a69d53 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:07.072977 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9fabbdb4-1a0d-4c1c-82d7-8072a8a69d53 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:07.074309 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9fabbdb4-1a0d-4c1c-82d7-8072a8a69d53 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.208263 Jun 20 18:47:07.082946 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 77/167] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:47:06 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:47:07.247779 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cb746bf4-3a6c-4ba3-92f8-53bd3735b1d7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:07.257123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-cb746bf4-3a6c-4ba3-92f8-53bd3735b1d7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.239445 Jun 20 18:47:07.258179 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 91/168] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:07 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:47:07.362563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d4535cd8-6798-4849-b767-1246855ae74a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:07.363201 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d4535cd8-6798-4849-b767-1246855ae74a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:07.373458 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d4535cd8-6798-4849-b767-1246855ae74a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:07.373908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d4535cd8-6798-4849-b767-1246855ae74a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:07.374747 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d4535cd8-6798-4849-b767-1246855ae74a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:07.375204 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d4535cd8-6798-4849-b767-1246855ae74a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:07.616190 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d4535cd8-6798-4849-b767-1246855ae74a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:07.636324 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d4535cd8-6798-4849-b767-1246855ae74a tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.281062 Jun 20 18:47:07.638212 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 78/169] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:07 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:07.760762 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c57f11b1-e370-4e44-8d89-871dcdb82b8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:07.761772 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c57f11b1-e370-4e44-8d89-871dcdb82b8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:07.769570 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c57f11b1-e370-4e44-8d89-871dcdb82b8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:07.770089 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c57f11b1-e370-4e44-8d89-871dcdb82b8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:07.770946 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c57f11b1-e370-4e44-8d89-871dcdb82b8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:07.771619 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c57f11b1-e370-4e44-8d89-871dcdb82b8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:07.976589 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c57f11b1-e370-4e44-8d89-871dcdb82b8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:07.984414 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c57f11b1-e370-4e44-8d89-871dcdb82b8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1361 microversion: 2.1 time: 0.231101 Jun 20 18:47:07.984984 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 92/170] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:07 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:08.093313 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9252cb70-3c58-422e-999c-a9f407a1df29 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:08.093931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9252cb70-3c58-422e-999c-a9f407a1df29 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:08.100627 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9252cb70-3c58-422e-999c-a9f407a1df29 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:08.101143 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9252cb70-3c58-422e-999c-a9f407a1df29 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:08.101996 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9252cb70-3c58-422e-999c-a9f407a1df29 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:08.102460 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9252cb70-3c58-422e-999c-a9f407a1df29 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:08.250744 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9252cb70-3c58-422e-999c-a9f407a1df29 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:08.260409 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9252cb70-3c58-422e-999c-a9f407a1df29 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:08.261915 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9252cb70-3c58-422e-999c-a9f407a1df29 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:08.263051 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9252cb70-3c58-422e-999c-a9f407a1df29 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.173863 Jun 20 18:47:08.263608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 79/171] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:47:08 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:47:08.277274 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d98d96d7-d372-403e-8f5d-28a0ca534644 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:08.277983 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d98d96d7-d372-403e-8f5d-28a0ca534644 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:08.284914 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d98d96d7-d372-403e-8f5d-28a0ca534644 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:08.285446 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d98d96d7-d372-403e-8f5d-28a0ca534644 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:08.286712 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d98d96d7-d372-403e-8f5d-28a0ca534644 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:08.287815 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d98d96d7-d372-403e-8f5d-28a0ca534644 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:08.543500 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d98d96d7-d372-403e-8f5d-28a0ca534644 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:08.553841 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d98d96d7-d372-403e-8f5d-28a0ca534644 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.280394 Jun 20 18:47:08.555016 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 93/172] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:08 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:08.617545 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-3f129457-a6fa-4a31-865f-1f3978c16695 req-321cf682-a6c3-4531-8def-5efe9286ba7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3d4888-1358-407b-9677-a8887d92ea3a", "name": "network-vif-plugged", "status": "completed", "tag": "2f87729e-9bda-4418-ae91-a86c8903e7f2"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:47:08.626567 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-3f129457-a6fa-4a31-865f-1f3978c16695 req-321cf682-a6c3-4531-8def-5efe9286ba7e service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:08.627279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-3f129457-a6fa-4a31-865f-1f3978c16695 req-321cf682-a6c3-4531-8def-5efe9286ba7e service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:08.642533 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-3f129457-a6fa-4a31-865f-1f3978c16695 req-321cf682-a6c3-4531-8def-5efe9286ba7e service nova] Creating event network-vif-plugged:2f87729e-9bda-4418-ae91-a86c8903e7f2 for instance bf3d4888-1358-407b-9677-a8887d92ea3a on hv-cinder-83697 Jun 20 18:47:08.650466 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-3f129457-a6fa-4a31-865f-1f3978c16695 req-321cf682-a6c3-4531-8def-5efe9286ba7e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036820 Jun 20 18:47:08.651864 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 80/173] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:47:08.658212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-297ac5be-9f4a-4ffa-b862-b1b0dbe89f36 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:08.659405 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-297ac5be-9f4a-4ffa-b862-b1b0dbe89f36 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:08.675331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-297ac5be-9f4a-4ffa-b862-b1b0dbe89f36 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:08.676049 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-297ac5be-9f4a-4ffa-b862-b1b0dbe89f36 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:08.680062 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-297ac5be-9f4a-4ffa-b862-b1b0dbe89f36 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:08.680695 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-297ac5be-9f4a-4ffa-b862-b1b0dbe89f36 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:08.886368 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-297ac5be-9f4a-4ffa-b862-b1b0dbe89f36 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:08.909102 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-297ac5be-9f4a-4ffa-b862-b1b0dbe89f36 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.255412 Jun 20 18:47:08.909945 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 94/174] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:08 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:09.002155 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7433f43a-c163-499f-b134-877051c3e865 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:09.002843 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7433f43a-c163-499f-b134-877051c3e865 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:09.011180 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7433f43a-c163-499f-b134-877051c3e865 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:09.011847 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7433f43a-c163-499f-b134-877051c3e865 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:09.013169 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7433f43a-c163-499f-b134-877051c3e865 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:09.014199 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7433f43a-c163-499f-b134-877051c3e865 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:09.193545 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7433f43a-c163-499f-b134-877051c3e865 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:09.206089 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7433f43a-c163-499f-b134-877051c3e865 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1547 microversion: 2.1 time: 0.206065 Jun 20 18:47:09.209768 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 81/175] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:08 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1547 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:09.226398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-780f6bac-9780-4768-badb-be5a1af356a3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:09.227011 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-780f6bac-9780-4768-badb-be5a1af356a3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:09.234451 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-780f6bac-9780-4768-badb-be5a1af356a3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:09.234451 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-780f6bac-9780-4768-badb-be5a1af356a3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:09.235803 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-780f6bac-9780-4768-badb-be5a1af356a3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:09.236387 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-780f6bac-9780-4768-badb-be5a1af356a3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:09.283029 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d6796887-71c2-495b-a677-38319ea28461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:09.283633 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d6796887-71c2-495b-a677-38319ea28461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:09.292305 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6796887-71c2-495b-a677-38319ea28461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:09.293316 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6796887-71c2-495b-a677-38319ea28461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:09.294704 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6796887-71c2-495b-a677-38319ea28461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:09.295496 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6796887-71c2-495b-a677-38319ea28461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:09.368496 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-780f6bac-9780-4768-badb-be5a1af356a3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145911 Jun 20 18:47:09.369269 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 95/176] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jun 20 18:47:09 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:47:09.578501 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2f151f9e-2986-448f-b199-e5808b535015 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:09.582496 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2f151f9e-2986-448f-b199-e5808b535015 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:09.599526 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2f151f9e-2986-448f-b199-e5808b535015 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:09.600252 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2f151f9e-2986-448f-b199-e5808b535015 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:09.601612 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2f151f9e-2986-448f-b199-e5808b535015 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:09.603494 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2f151f9e-2986-448f-b199-e5808b535015 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:09.804911 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d6796887-71c2-495b-a677-38319ea28461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:09.809769 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2f151f9e-2986-448f-b199-e5808b535015 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:09.817491 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2f151f9e-2986-448f-b199-e5808b535015 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.249551 Jun 20 18:47:09.817704 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d6796887-71c2-495b-a677-38319ea28461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:09.818508 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 96/177] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:09 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:09.827363 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d6796887-71c2-495b-a677-38319ea28461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:09.827363 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d6796887-71c2-495b-a677-38319ea28461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1407 microversion: 2.20 time: 0.546912 Jun 20 18:47:09.839154 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 82/178] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:47:09 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1407 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:47:09.926426 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d4624413-ba44-4fe2-8cc9-f261e019eef1 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:09.927149 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d4624413-ba44-4fe2-8cc9-f261e019eef1 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:09.936092 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d4624413-ba44-4fe2-8cc9-f261e019eef1 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:09.939178 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d4624413-ba44-4fe2-8cc9-f261e019eef1 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:09.940295 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d4624413-ba44-4fe2-8cc9-f261e019eef1 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:09.942251 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d4624413-ba44-4fe2-8cc9-f261e019eef1 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:10.252600 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d4624413-ba44-4fe2-8cc9-f261e019eef1 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:10.261773 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d4624413-ba44-4fe2-8cc9-f261e019eef1 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.339724 Jun 20 18:47:10.263025 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 97/179] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:09 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:10.834950 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b34a6066-28da-4a13-b64d-e71f8a446256 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:10.835543 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b34a6066-28da-4a13-b64d-e71f8a446256 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:10.842102 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c51f801c-75db-43a6-8a6a-eaaea0c0ccb7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:10.843396 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c51f801c-75db-43a6-8a6a-eaaea0c0ccb7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:10.864968 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c51f801c-75db-43a6-8a6a-eaaea0c0ccb7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:10.867429 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b34a6066-28da-4a13-b64d-e71f8a446256 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:10.867883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b34a6066-28da-4a13-b64d-e71f8a446256 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:10.868659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b34a6066-28da-4a13-b64d-e71f8a446256 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:10.869085 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b34a6066-28da-4a13-b64d-e71f8a446256 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:10.871222 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c51f801c-75db-43a6-8a6a-eaaea0c0ccb7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:10.872206 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c51f801c-75db-43a6-8a6a-eaaea0c0ccb7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:10.872650 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c51f801c-75db-43a6-8a6a-eaaea0c0ccb7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:11.075454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c51f801c-75db-43a6-8a6a-eaaea0c0ccb7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:11.084567 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c51f801c-75db-43a6-8a6a-eaaea0c0ccb7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:11.086056 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c51f801c-75db-43a6-8a6a-eaaea0c0ccb7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:11.087218 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c51f801c-75db-43a6-8a6a-eaaea0c0ccb7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1599 microversion: 2.20 time: 0.248954 Jun 20 18:47:11.087771 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 98/180] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:47:10 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1599 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:47:11.105235 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8495a169-576c-4b9f-a18e-dea6be1a018c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:11.105927 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8495a169-576c-4b9f-a18e-dea6be1a018c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:11.112825 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8495a169-576c-4b9f-a18e-dea6be1a018c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:11.113472 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8495a169-576c-4b9f-a18e-dea6be1a018c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:11.114389 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8495a169-576c-4b9f-a18e-dea6be1a018c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:11.114984 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8495a169-576c-4b9f-a18e-dea6be1a018c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:11.199144 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b34a6066-28da-4a13-b64d-e71f8a446256 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:11.209469 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b34a6066-28da-4a13-b64d-e71f8a446256 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.378403 Jun 20 18:47:11.211245 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 83/181] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:10 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:11.215010 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8495a169-576c-4b9f-a18e-dea6be1a018c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.113483 Jun 20 18:47:11.215575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 99/182] 10.222.0.43 () {60 vars in 1315 bytes} [Mon Jun 20 18:47:11 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 18:47:11.285833 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ce720cc8-2711-410e-81d1-881bf14c3109 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:11.292536 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ce720cc8-2711-410e-81d1-881bf14c3109 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:11.304887 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ce720cc8-2711-410e-81d1-881bf14c3109 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:11.306935 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ce720cc8-2711-410e-81d1-881bf14c3109 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:11.309038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ce720cc8-2711-410e-81d1-881bf14c3109 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:11.309752 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ce720cc8-2711-410e-81d1-881bf14c3109 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:11.674065 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-129ab9a2-44eb-432c-8388-56445575b36d req-b7890b02-6a2d-4a64-9048-e3543a18a55a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2614c08f-0c19-4066-8c87-551d4ac2f725", "tag": "ffa2211c-05a6-4fea-b138-2d18f0a69e0b"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:47:11.688154 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-129ab9a2-44eb-432c-8388-56445575b36d req-b7890b02-6a2d-4a64-9048-e3543a18a55a service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:11.690169 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-129ab9a2-44eb-432c-8388-56445575b36d req-b7890b02-6a2d-4a64-9048-e3543a18a55a service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:11.696672 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ce720cc8-2711-410e-81d1-881bf14c3109 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:11.712951 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ce720cc8-2711-410e-81d1-881bf14c3109 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1315 microversion: 2.1 time: 0.436895 Jun 20 18:47:11.730904 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 84/183] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:11 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:11.753152 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-129ab9a2-44eb-432c-8388-56445575b36d req-b7890b02-6a2d-4a64-9048-e3543a18a55a service nova] Creating event network-changed:ffa2211c-05a6-4fea-b138-2d18f0a69e0b for instance 2614c08f-0c19-4066-8c87-551d4ac2f725 on hv-cinder-83697 Jun 20 18:47:11.764521 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-129ab9a2-44eb-432c-8388-56445575b36d req-b7890b02-6a2d-4a64-9048-e3543a18a55a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094348 Jun 20 18:47:11.768464 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 100/184] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:47:12.228703 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a4b077a8-8653-4840-809f-37e5db01c781 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:12.229458 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a4b077a8-8653-4840-809f-37e5db01c781 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:12.248631 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a4b077a8-8653-4840-809f-37e5db01c781 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:12.256882 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a4b077a8-8653-4840-809f-37e5db01c781 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:12.257868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a4b077a8-8653-4840-809f-37e5db01c781 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:12.258408 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a4b077a8-8653-4840-809f-37e5db01c781 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:12.482379 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a4b077a8-8653-4840-809f-37e5db01c781 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:12.488872 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:12.492696 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a4b077a8-8653-4840-809f-37e5db01c781 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.268074 Jun 20 18:47:12.496137 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 85/185] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:12 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:12.733416 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9a7a901a-1440-4f44-86d0-db3cb86bc646 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:12.734653 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9a7a901a-1440-4f44-86d0-db3cb86bc646 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:12.743310 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9a7a901a-1440-4f44-86d0-db3cb86bc646 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:12.744050 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9a7a901a-1440-4f44-86d0-db3cb86bc646 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:12.745323 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9a7a901a-1440-4f44-86d0-db3cb86bc646 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:12.746248 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9a7a901a-1440-4f44-86d0-db3cb86bc646 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:13.091967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9a7a901a-1440-4f44-86d0-db3cb86bc646 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:13.101798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9a7a901a-1440-4f44-86d0-db3cb86bc646 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1502 microversion: 2.1 time: 0.371177 Jun 20 18:47:13.102727 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 101/186] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:12 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1502 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:13.229063 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-7fc3a8aa-0bda-4c2d-8a40-c3e81b706ca0 req-69fb185b-782c-4674-9500-ecd7038670e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa52c387-5b77-4644-85c8-691b22dfeb78", "tag": "920abf72-084f-4d4e-be79-106c82668c67"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:47:13.250288 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-7fc3a8aa-0bda-4c2d-8a40-c3e81b706ca0 req-69fb185b-782c-4674-9500-ecd7038670e5 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:13.252101 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-7fc3a8aa-0bda-4c2d-8a40-c3e81b706ca0 req-69fb185b-782c-4674-9500-ecd7038670e5 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:13.288298 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-7fc3a8aa-0bda-4c2d-8a40-c3e81b706ca0 req-69fb185b-782c-4674-9500-ecd7038670e5 service nova] Creating event network-changed:920abf72-084f-4d4e-be79-106c82668c67 for instance aa52c387-5b77-4644-85c8-691b22dfeb78 on hv-cinder-83697 Jun 20 18:47:13.299779 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-7fc3a8aa-0bda-4c2d-8a40-c3e81b706ca0 req-69fb185b-782c-4674-9500-ecd7038670e5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074316 Jun 20 18:47:13.300638 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 86/187] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:47:13.517344 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9d7876aa-79cf-4ab2-bb16-e66da901cb0a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:13.518181 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9d7876aa-79cf-4ab2-bb16-e66da901cb0a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:13.526857 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9d7876aa-79cf-4ab2-bb16-e66da901cb0a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:13.531627 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9d7876aa-79cf-4ab2-bb16-e66da901cb0a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:13.532653 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9d7876aa-79cf-4ab2-bb16-e66da901cb0a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:13.534710 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9d7876aa-79cf-4ab2-bb16-e66da901cb0a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:13.736460 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9d7876aa-79cf-4ab2-bb16-e66da901cb0a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:13.744757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9d7876aa-79cf-4ab2-bb16-e66da901cb0a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1365 microversion: 2.1 time: 0.236102 Jun 20 18:47:13.746436 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 102/188] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:13 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:14.763270 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ed5e3655-f5ab-4caa-8f9e-3e6303920fc9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:14.764790 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ed5e3655-f5ab-4caa-8f9e-3e6303920fc9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:14.781088 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed5e3655-f5ab-4caa-8f9e-3e6303920fc9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:14.783552 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed5e3655-f5ab-4caa-8f9e-3e6303920fc9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:14.786562 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed5e3655-f5ab-4caa-8f9e-3e6303920fc9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:14.787636 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed5e3655-f5ab-4caa-8f9e-3e6303920fc9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:15.060767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ed5e3655-f5ab-4caa-8f9e-3e6303920fc9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:15.069883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ed5e3655-f5ab-4caa-8f9e-3e6303920fc9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1554 microversion: 2.1 time: 0.310523 Jun 20 18:47:15.070885 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 87/189] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:14 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1554 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:47:15.087591 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-3f983d8a-bdc7-49fa-885d-1bee583fb4eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:15.088627 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-3f983d8a-bdc7-49fa-885d-1bee583fb4eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:15.096467 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3f983d8a-bdc7-49fa-885d-1bee583fb4eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:15.097124 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3f983d8a-bdc7-49fa-885d-1bee583fb4eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:15.098035 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3f983d8a-bdc7-49fa-885d-1bee583fb4eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:15.098622 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3f983d8a-bdc7-49fa-885d-1bee583fb4eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:15.228143 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-3f983d8a-bdc7-49fa-885d-1bee583fb4eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144423 Jun 20 18:47:15.228901 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 103/190] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jun 20 18:47:15 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:47:15.747139 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-87e5e003-eb96-49f3-9c77-a40fe5ddce68 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ab94881-5d04-4283-a00f-564c1bef5741"}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:47:15.748221 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-87e5e003-eb96-49f3-9c77-a40fe5ddce68 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:15.751899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=97 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:15.755852 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-87e5e003-eb96-49f3-9c77-a40fe5ddce68 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:15.756298 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-87e5e003-eb96-49f3-9c77-a40fe5ddce68 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:15.757074 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-87e5e003-eb96-49f3-9c77-a40fe5ddce68 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:15.757566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-87e5e003-eb96-49f3-9c77-a40fe5ddce68 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:16.360314 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-f932097d-6af7-45a4-aa90-f86f0f1c514b req-f001d15f-fc41-4103-9647-781f28049e45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3d4888-1358-407b-9677-a8887d92ea3a", "tag": "2f87729e-9bda-4418-ae91-a86c8903e7f2"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:47:16.368789 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-f932097d-6af7-45a4-aa90-f86f0f1c514b req-f001d15f-fc41-4103-9647-781f28049e45 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:16.369326 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-f932097d-6af7-45a4-aa90-f86f0f1c514b req-f001d15f-fc41-4103-9647-781f28049e45 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:16.382909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-f932097d-6af7-45a4-aa90-f86f0f1c514b req-f001d15f-fc41-4103-9647-781f28049e45 service nova] Creating event network-changed:2f87729e-9bda-4418-ae91-a86c8903e7f2 for instance bf3d4888-1358-407b-9677-a8887d92ea3a on hv-cinder-83697 Jun 20 18:47:16.388657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-f932097d-6af7-45a4-aa90-f86f0f1c514b req-f001d15f-fc41-4103-9647-781f28049e45 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032105 Jun 20 18:47:16.389336 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 104/191] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:47:20.323622 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-87e5e003-eb96-49f3-9c77-a40fe5ddce68 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "POST /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.580128 Jun 20 18:47:20.324652 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 88/192] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jun 20 18:47:15 2022] POST /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190/os-volume_attachments => generated 194 bytes in 4582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:47:38.435762 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=41 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:38.436442 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=76 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:38.440956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9520f396-5eea-43cd-9fc8-1ebde509c128 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:38.441531 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9520f396-5eea-43cd-9fc8-1ebde509c128 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:38.448436 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9520f396-5eea-43cd-9fc8-1ebde509c128 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:38.448884 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9520f396-5eea-43cd-9fc8-1ebde509c128 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:38.449680 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9520f396-5eea-43cd-9fc8-1ebde509c128 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:38.450111 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9520f396-5eea-43cd-9fc8-1ebde509c128 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:38.476709 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9520f396-5eea-43cd-9fc8-1ebde509c128 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:47:38.575366 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9520f396-5eea-43cd-9fc8-1ebde509c128 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 204 len: 0 microversion: 2.1 time: 0.140593 Jun 20 18:47:38.576267 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 105/193] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:47:38 2022] DELETE /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:47:38.582984 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:38.583855 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:38.588080 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d0453e4d-f7b7-42d5-b8ed-2887bd759304 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:38.588773 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d0453e4d-f7b7-42d5-b8ed-2887bd759304 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:38.596811 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d0453e4d-f7b7-42d5-b8ed-2887bd759304 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:38.597254 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d0453e4d-f7b7-42d5-b8ed-2887bd759304 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:38.598128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d0453e4d-f7b7-42d5-b8ed-2887bd759304 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:38.598425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d0453e4d-f7b7-42d5-b8ed-2887bd759304 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:38.744810 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d0453e4d-f7b7-42d5-b8ed-2887bd759304 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:38.752901 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d0453e4d-f7b7-42d5-b8ed-2887bd759304 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1554 microversion: 2.1 time: 0.171542 Jun 20 18:47:38.753455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 89/194] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:38 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:47:39.771965 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-3e23dcb5-2a0d-451d-a55c-941888b647be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:39.772680 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-3e23dcb5-2a0d-451d-a55c-941888b647be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:39.778941 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3e23dcb5-2a0d-451d-a55c-941888b647be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:39.779328 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3e23dcb5-2a0d-451d-a55c-941888b647be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:39.780079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3e23dcb5-2a0d-451d-a55c-941888b647be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:39.780516 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3e23dcb5-2a0d-451d-a55c-941888b647be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:39.912893 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-3e23dcb5-2a0d-451d-a55c-941888b647be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:39.920855 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-3e23dcb5-2a0d-451d-a55c-941888b647be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1554 microversion: 2.1 time: 0.153235 Jun 20 18:47:39.921409 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 106/195] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:39 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:40.937674 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6b3a5dad-e1ea-45f4-8041-192342b063c6 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:40.938312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6b3a5dad-e1ea-45f4-8041-192342b063c6 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:40.944723 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6b3a5dad-e1ea-45f4-8041-192342b063c6 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:40.945158 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6b3a5dad-e1ea-45f4-8041-192342b063c6 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:40.945909 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6b3a5dad-e1ea-45f4-8041-192342b063c6 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:40.946346 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6b3a5dad-e1ea-45f4-8041-192342b063c6 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:41.079974 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6b3a5dad-e1ea-45f4-8041-192342b063c6 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:41.087799 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6b3a5dad-e1ea-45f4-8041-192342b063c6 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1554 microversion: 2.1 time: 0.154180 Jun 20 18:47:41.088344 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 90/196] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:40 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:42.104306 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-3f51e31c-29f5-477f-899b-d8a69f027df7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:42.104909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-3f51e31c-29f5-477f-899b-d8a69f027df7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:42.111485 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3f51e31c-29f5-477f-899b-d8a69f027df7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:42.111872 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3f51e31c-29f5-477f-899b-d8a69f027df7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:42.112622 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3f51e31c-29f5-477f-899b-d8a69f027df7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:42.113053 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3f51e31c-29f5-477f-899b-d8a69f027df7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:42.236962 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-3f51e31c-29f5-477f-899b-d8a69f027df7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:42.245081 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-3f51e31c-29f5-477f-899b-d8a69f027df7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1554 microversion: 2.1 time: 0.144569 Jun 20 18:47:42.245640 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 107/197] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:42 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1554 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:43.262385 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fa796100-8cc2-4ee3-a2ca-5c7bfdc4a720 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:43.263012 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fa796100-8cc2-4ee3-a2ca-5c7bfdc4a720 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:43.270027 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fa796100-8cc2-4ee3-a2ca-5c7bfdc4a720 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:43.270466 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fa796100-8cc2-4ee3-a2ca-5c7bfdc4a720 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:43.271243 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fa796100-8cc2-4ee3-a2ca-5c7bfdc4a720 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:43.271669 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fa796100-8cc2-4ee3-a2ca-5c7bfdc4a720 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:43.397180 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fa796100-8cc2-4ee3-a2ca-5c7bfdc4a720 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:43.405021 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fa796100-8cc2-4ee3-a2ca-5c7bfdc4a720 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1554 microversion: 2.1 time: 0.146417 Jun 20 18:47:43.405577 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 91/198] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:43 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:44.421199 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-64162d60-34d1-41c5-a5d4-0cdd5d500624 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:44.422287 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-64162d60-34d1-41c5-a5d4-0cdd5d500624 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:44.428301 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-64162d60-34d1-41c5-a5d4-0cdd5d500624 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:44.428740 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-64162d60-34d1-41c5-a5d4-0cdd5d500624 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:44.429483 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-64162d60-34d1-41c5-a5d4-0cdd5d500624 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:44.429906 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-64162d60-34d1-41c5-a5d4-0cdd5d500624 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:44.554539 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-64162d60-34d1-41c5-a5d4-0cdd5d500624 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:44.562302 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-64162d60-34d1-41c5-a5d4-0cdd5d500624 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1554 microversion: 2.1 time: 0.144858 Jun 20 18:47:44.563505 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 108/199] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:44 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:45.581301 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-92903322-d077-41b5-ac0a-614e7788b267 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:45.581967 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-92903322-d077-41b5-ac0a-614e7788b267 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:45.590052 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-92903322-d077-41b5-ac0a-614e7788b267 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:45.590501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-92903322-d077-41b5-ac0a-614e7788b267 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:45.591303 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-92903322-d077-41b5-ac0a-614e7788b267 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:45.591743 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-92903322-d077-41b5-ac0a-614e7788b267 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:45.731778 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-92903322-d077-41b5-ac0a-614e7788b267 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:45.739564 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-92903322-d077-41b5-ac0a-614e7788b267 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1554 microversion: 2.1 time: 0.163565 Jun 20 18:47:45.740125 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 92/200] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:45 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:46.756107 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-3367dcb9-8fbe-4e62-8e40-ed69a01940f7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:46.756702 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-3367dcb9-8fbe-4e62-8e40-ed69a01940f7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:46.762989 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3367dcb9-8fbe-4e62-8e40-ed69a01940f7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:46.763502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3367dcb9-8fbe-4e62-8e40-ed69a01940f7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:46.764329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3367dcb9-8fbe-4e62-8e40-ed69a01940f7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:46.764826 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3367dcb9-8fbe-4e62-8e40-ed69a01940f7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:47.056304 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-3367dcb9-8fbe-4e62-8e40-ed69a01940f7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:47.065058 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-3367dcb9-8fbe-4e62-8e40-ed69a01940f7 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1554 microversion: 2.1 time: 0.312734 Jun 20 18:47:47.066010 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 109/201] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:46 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1554 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:47.273539 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-805d95ab-859c-450f-886e-cb2f2c0bd272 req-6867532e-883f-4bfc-8d49-3dfcc1e6b0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1fde39e-3570-4635-a3c3-b3aea5abf190", "name": "network-vif-deleted", "tag": "afba41a9-6713-4c38-829a-4c3d915f0d01"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:47:47.283648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-805d95ab-859c-450f-886e-cb2f2c0bd272 req-6867532e-883f-4bfc-8d49-3dfcc1e6b0a8 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:47.284215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-805d95ab-859c-450f-886e-cb2f2c0bd272 req-6867532e-883f-4bfc-8d49-3dfcc1e6b0a8 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:47.296621 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-805d95ab-859c-450f-886e-cb2f2c0bd272 req-6867532e-883f-4bfc-8d49-3dfcc1e6b0a8 service nova] Creating event network-vif-deleted:afba41a9-6713-4c38-829a-4c3d915f0d01 for instance b1fde39e-3570-4635-a3c3-b3aea5abf190 on hv-cinder-83697 Jun 20 18:47:47.302654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-805d95ab-859c-450f-886e-cb2f2c0bd272 req-6867532e-883f-4bfc-8d49-3dfcc1e6b0a8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032793 Jun 20 18:47:47.303666 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 93/202] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:47:48.082683 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ae9f6abe-3885-48a1-ac6e-bb4f7674f519 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:48.083319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ae9f6abe-3885-48a1-ac6e-bb4f7674f519 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:48.089569 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ae9f6abe-3885-48a1-ac6e-bb4f7674f519 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:48.090011 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ae9f6abe-3885-48a1-ac6e-bb4f7674f519 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:48.090861 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ae9f6abe-3885-48a1-ac6e-bb4f7674f519 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:48.091316 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ae9f6abe-3885-48a1-ac6e-bb4f7674f519 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:48.122023 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ae9f6abe-3885-48a1-ac6e-bb4f7674f519 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:48.122471 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ae9f6abe-3885-48a1-ac6e-bb4f7674f519 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:48.122940 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-ae9f6abe-3885-48a1-ac6e-bb4f7674f519 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lazy-loading 'fault' on Instance uuid b1fde39e-3570-4635-a3c3-b3aea5abf190 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:47:48.182302 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ae9f6abe-3885-48a1-ac6e-bb4f7674f519 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ada4576c0084912b41c846d849ce6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f1a2549de24c31910eb3cdb809c5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:48.194102 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ae9f6abe-3885-48a1-ac6e-bb4f7674f519 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 200 len: 1351 microversion: 2.1 time: 0.114917 Jun 20 18:47:48.197166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 110/203] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:48 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 1351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:47:49.213383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-db04c023-a1de-43d7-b9c0-2c1fa9d401be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:49.214096 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-db04c023-a1de-43d7-b9c0-2c1fa9d401be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:49.220754 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-db04c023-a1de-43d7-b9c0-2c1fa9d401be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:49.221133 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-db04c023-a1de-43d7-b9c0-2c1fa9d401be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:49.221885 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-db04c023-a1de-43d7-b9c0-2c1fa9d401be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:49.222315 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-db04c023-a1de-43d7-b9c0-2c1fa9d401be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:49.235888 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-db04c023-a1de-43d7-b9c0-2c1fa9d401be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] HTTP exception thrown: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-db04c023-a1de-43d7-b9c0-2c1fa9d401be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Request method failure captured: Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 HTTP/1.1 Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMB6XipoyHD3Z2zeq7cKhqVEuIopz4jvu_DFNWIu06GFvlo_jJ_7fCB5osARRjW3gEzlVnrIhVCF1yp_Q75t4x57C7EmazZO3EYnYtVfKRIIKORLkosbKboEldehM3Mr6wM_qsVBNy61eo2vZia1fGXOKTVZ16yzfP_DdZJypgXxeaA Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 21f1a2549de24c31910eb3cdb809c5e9 Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-DeleteServersTestJSON-618394810 Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:47:49.240527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:47:49.242064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_21f1a2549de24c31910eb3cdb809c5e9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/21f1a2549de24c31910eb3cdb809c5e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21f1a2549de24c31910eb3cdb809c5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21f1a2549de24c31910eb3cdb809c5e9"}]}] Jun 20 18:47:49.242064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-DeleteServersTestJSON-618394810 Jun 20 18:47:49.242064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 21f1a2549de24c31910eb3cdb809c5e9 Jun 20 18:47:49.242064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-DeleteServersTestJSON-618394810 Jun 20 18:47:49.242064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-DeleteServersTestJSON-618394810-project Jun 20 18:47:49.242064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:47:49.242064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:47:49.242064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 2ada4576c0084912b41c846d849ce6ee Jun 20 18:47:49.242064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-DeleteServersTestJSON-618394810-project Jun 20 18:47:49.242064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:47:49.242064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:49.242064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': 'b1fde39e-3570-4635-a3c3-b3aea5abf190'} Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:47:49.242953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:49.244078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:47:49.245222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-db04c023-a1de-43d7-b9c0-2c1fa9d401be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Returning 404 to user: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:47:49.245222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-db04c023-a1de-43d7-b9c0-2c1fa9d401be tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 404 len: 111 microversion: 2.1 time: 0.033309 Jun 20 18:47:49.245222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 94/204] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:49 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:47:49.352899 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a67be798-fbfe-439f-b633-839023fe1c2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:49.353929 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a67be798-fbfe-439f-b633-839023fe1c2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:49.360845 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a67be798-fbfe-439f-b633-839023fe1c2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:49.361393 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a67be798-fbfe-439f-b633-839023fe1c2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:49.362036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a67be798-fbfe-439f-b633-839023fe1c2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:49.362469 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a67be798-fbfe-439f-b633-839023fe1c2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:49.388442 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-a67be798-fbfe-439f-b633-839023fe1c2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] HTTP exception thrown: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a67be798-fbfe-439f-b633-839023fe1c2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Request method failure captured: Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190/os-volume_attachments HTTP/1.1 Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMB6XipoyHD3Z2zeq7cKhqVEuIopz4jvu_DFNWIu06GFvlo_jJ_7fCB5osARRjW3gEzlVnrIhVCF1yp_Q75t4x57C7EmazZO3EYnYtVfKRIIKORLkosbKboEldehM3Mr6wM_qsVBNy61eo2vZia1fGXOKTVZ16yzfP_DdZJypgXxeaA Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 21f1a2549de24c31910eb3cdb809c5e9 Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-DeleteServersTestJSON-618394810 Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:47:49.392757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:47:49.394195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_21f1a2549de24c31910eb3cdb809c5e9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/21f1a2549de24c31910eb3cdb809c5e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21f1a2549de24c31910eb3cdb809c5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21f1a2549de24c31910eb3cdb809c5e9"}]}] Jun 20 18:47:49.394195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-DeleteServersTestJSON-618394810 Jun 20 18:47:49.394195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 21f1a2549de24c31910eb3cdb809c5e9 Jun 20 18:47:49.394195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-DeleteServersTestJSON-618394810 Jun 20 18:47:49.394195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-DeleteServersTestJSON-618394810-project Jun 20 18:47:49.394195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:47:49.394195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:47:49.394195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 2ada4576c0084912b41c846d849ce6ee Jun 20 18:47:49.394195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-DeleteServersTestJSON-618394810-project Jun 20 18:47:49.394195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:47:49.394195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:49.394195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'server_id': 'b1fde39e-3570-4635-a3c3-b3aea5abf190'} Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:47:49.395078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:49.396329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:47:49.397398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a67be798-fbfe-439f-b633-839023fe1c2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Returning 404 to user: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:47:49.397398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a67be798-fbfe-439f-b633-839023fe1c2f tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045322 Jun 20 18:47:49.397398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 111/205] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:47:49 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:47:50.588443 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fd028ca5-8ad5-429b-9256-903b6ff4c040 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:50.588929 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fd028ca5-8ad5-429b-9256-903b6ff4c040 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:50.595715 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fd028ca5-8ad5-429b-9256-903b6ff4c040 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:50.596153 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fd028ca5-8ad5-429b-9256-903b6ff4c040 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:50.596900 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fd028ca5-8ad5-429b-9256-903b6ff4c040 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:50.597329 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fd028ca5-8ad5-429b-9256-903b6ff4c040 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:50.611164 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-fd028ca5-8ad5-429b-9256-903b6ff4c040 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] HTTP exception thrown: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fd028ca5-8ad5-429b-9256-903b6ff4c040 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Request method failure captured: Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: DELETE /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 HTTP/1.1 Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMB6XipoyHD3Z2zeq7cKhqVEuIopz4jvu_DFNWIu06GFvlo_jJ_7fCB5osARRjW3gEzlVnrIhVCF1yp_Q75t4x57C7EmazZO3EYnYtVfKRIIKORLkosbKboEldehM3Mr6wM_qsVBNy61eo2vZia1fGXOKTVZ16yzfP_DdZJypgXxeaA Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 21f1a2549de24c31910eb3cdb809c5e9 Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-DeleteServersTestJSON-618394810 Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:47:50.612687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:47:50.614034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_21f1a2549de24c31910eb3cdb809c5e9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/21f1a2549de24c31910eb3cdb809c5e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21f1a2549de24c31910eb3cdb809c5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21f1a2549de24c31910eb3cdb809c5e9"}]}] Jun 20 18:47:50.614034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-DeleteServersTestJSON-618394810 Jun 20 18:47:50.614034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 21f1a2549de24c31910eb3cdb809c5e9 Jun 20 18:47:50.614034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-DeleteServersTestJSON-618394810 Jun 20 18:47:50.614034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-DeleteServersTestJSON-618394810-project Jun 20 18:47:50.614034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:47:50.614034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:47:50.614034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 2ada4576c0084912b41c846d849ce6ee Jun 20 18:47:50.614034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-DeleteServersTestJSON-618394810-project Jun 20 18:47:50.614034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:47:50.614034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:50.614034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': 'b1fde39e-3570-4635-a3c3-b3aea5abf190'} Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:47:50.614848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:50.616244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:47:50.617903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fd028ca5-8ad5-429b-9256-903b6ff4c040 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Returning 404 to user: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:47:50.617903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fd028ca5-8ad5-429b-9256-903b6ff4c040 tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 404 len: 111 microversion: 2.1 time: 0.029429 Jun 20 18:47:50.617903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 95/206] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:47:50 2022] DELETE /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:47:50.622457 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b85ce535-4fd3-48b1-83bb-8dbbbde4ce1e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:50.623089 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b85ce535-4fd3-48b1-83bb-8dbbbde4ce1e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] [instance: b1fde39e-3570-4635-a3c3-b3aea5abf190] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:50.629682 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b85ce535-4fd3-48b1-83bb-8dbbbde4ce1e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:50.630116 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b85ce535-4fd3-48b1-83bb-8dbbbde4ce1e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:50.630860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b85ce535-4fd3-48b1-83bb-8dbbbde4ce1e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:50.631309 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b85ce535-4fd3-48b1-83bb-8dbbbde4ce1e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:50.644517 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-b85ce535-4fd3-48b1-83bb-8dbbbde4ce1e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] HTTP exception thrown: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b85ce535-4fd3-48b1-83bb-8dbbbde4ce1e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Request method failure captured: Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 HTTP/1.1 Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMB6XipoyHD3Z2zeq7cKhqVEuIopz4jvu_DFNWIu06GFvlo_jJ_7fCB5osARRjW3gEzlVnrIhVCF1yp_Q75t4x57C7EmazZO3EYnYtVfKRIIKORLkosbKboEldehM3Mr6wM_qsVBNy61eo2vZia1fGXOKTVZ16yzfP_DdZJypgXxeaA Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 21f1a2549de24c31910eb3cdb809c5e9 Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-DeleteServersTestJSON-618394810 Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:47:50.646588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:47:50.647783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_21f1a2549de24c31910eb3cdb809c5e9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/21f1a2549de24c31910eb3cdb809c5e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21f1a2549de24c31910eb3cdb809c5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21f1a2549de24c31910eb3cdb809c5e9"}]}] Jun 20 18:47:50.647783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-DeleteServersTestJSON-618394810 Jun 20 18:47:50.647783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 21f1a2549de24c31910eb3cdb809c5e9 Jun 20 18:47:50.647783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-DeleteServersTestJSON-618394810 Jun 20 18:47:50.647783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-DeleteServersTestJSON-618394810-project Jun 20 18:47:50.647783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:47:50.647783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:47:50.647783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 2ada4576c0084912b41c846d849ce6ee Jun 20 18:47:50.647783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-DeleteServersTestJSON-618394810-project Jun 20 18:47:50.647783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:47:50.647783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:50.647783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': 'b1fde39e-3570-4635-a3c3-b3aea5abf190'} Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:47:50.648480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. Jun 20 18:47:50.649673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:47:50.650828 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b85ce535-4fd3-48b1-83bb-8dbbbde4ce1e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] Returning 404 to user: Instance b1fde39e-3570-4635-a3c3-b3aea5abf190 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:47:50.650828 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b85ce535-4fd3-48b1-83bb-8dbbbde4ce1e tempest-DeleteServersTestJSON-618394810 tempest-DeleteServersTestJSON-618394810-project] 10.222.0.43 "GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190" status: 404 len: 111 microversion: 2.1 time: 0.029436 Jun 20 18:47:50.650828 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 112/207] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:50 2022] GET /compute/v2.1/servers/b1fde39e-3570-4635-a3c3-b3aea5abf190 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:47:58.192612 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-876385364", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "networks": [{"uuid": "73703d53-31d3-4ad5-aeab-3950df8b9a15"}]}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:47:58.268367 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.network.neutron [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] validate_networks() for [('73703d53-31d3-4ad5-aeab-3950df8b9a15', None, None, None, None, None)] {{(pid=124189) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:47:59.256090 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Flavor limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:47:59.257217 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Image limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:47:59.258040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Flavor pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:47:59.258647 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Image pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:47:59.259236 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:47:59.275317 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:59.276244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:59.277303 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:47:59.277975 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:47:59.307641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Getting quotas for project 98d56a21c52b49ffbc838f590fe76d29. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:47:59.314306 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Getting quotas for user 27e3a6db1a9b4c38bb8a5697ed08f8e7 and project 98d56a21c52b49ffbc838f590fe76d29. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:47:59.331110 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Going to run 1 instances... {{(pid=124189) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:47:59.339934 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124189) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:47:59.445037 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a8fa1c9f-36e2-4fe5-a02c-a01a7a7f3b74 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.255938 Jun 20 18:47:59.452612 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 96/208] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:47:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:47:59.458390 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b908b16f-e229-4b31-aa3b-65d47cf0b2e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:47:59.461117 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b908b16f-e229-4b31-aa3b-65d47cf0b2e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:47:59.555860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b908b16f-e229-4b31-aa3b-65d47cf0b2e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:47:59.575331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b908b16f-e229-4b31-aa3b-65d47cf0b2e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1218 microversion: 2.1 time: 0.117060 Jun 20 18:47:59.578551 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 113/209] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:47:59 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:00.595705 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-36343001-1ef8-4062-b46c-04f8d3dc5e5c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:00.596453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-36343001-1ef8-4062-b46c-04f8d3dc5e5c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:00.606550 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-36343001-1ef8-4062-b46c-04f8d3dc5e5c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:00.607040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-36343001-1ef8-4062-b46c-04f8d3dc5e5c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:00.611386 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-36343001-1ef8-4062-b46c-04f8d3dc5e5c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:00.611838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-36343001-1ef8-4062-b46c-04f8d3dc5e5c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:00.778210 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-36343001-1ef8-4062-b46c-04f8d3dc5e5c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:00.815028 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-36343001-1ef8-4062-b46c-04f8d3dc5e5c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1270 microversion: 2.1 time: 0.223817 Jun 20 18:48:00.816502 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 97/210] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:00 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1270 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:01.057192 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:01.441828 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-591915262", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:48:01.517939 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.network.neutron [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] validate_networks() for [('619214b4-923a-4887-a5d4-59de0868e3a9', None, None, None, None, None)] {{(pid=124190) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:48:01.841368 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-91fc57b5-b320-4ac8-8b87-6bec0f8c9af1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:01.843767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-91fc57b5-b320-4ac8-8b87-6bec0f8c9af1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:01.868992 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91fc57b5-b320-4ac8-8b87-6bec0f8c9af1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:01.869673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91fc57b5-b320-4ac8-8b87-6bec0f8c9af1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:01.871015 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91fc57b5-b320-4ac8-8b87-6bec0f8c9af1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:01.871599 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91fc57b5-b320-4ac8-8b87-6bec0f8c9af1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:02.071920 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-91fc57b5-b320-4ac8-8b87-6bec0f8c9af1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:02.083534 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-91fc57b5-b320-4ac8-8b87-6bec0f8c9af1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1318 microversion: 2.1 time: 0.252164 Jun 20 18:48:02.089936 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 98/211] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:01 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:02.235860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Flavor limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:48:02.237182 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Image limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:48:02.237846 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Flavor pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:48:02.238422 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Image pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:48:02.238835 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:48:02.252290 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:02.252738 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:02.253550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:02.253983 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:02.272926 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Getting quotas for project 7b4a919be31b4c74a3197d98ecec7fde. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:48:02.276970 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Getting quotas for user 31fed190cac24d1b8326425f737e220b and project 7b4a919be31b4c74a3197d98ecec7fde. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:48:02.289593 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Going to run 1 instances... {{(pid=124190) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:48:02.292612 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124190) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:48:02.346896 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d6fb9fb7-81c0-4cab-8f3b-46cd43fc884c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.297658 Jun 20 18:48:02.347898 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 114/212] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:48:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:48:02.357544 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-86e7c47a-c06d-4c81-b029-a5fdf64bb9f9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:02.358232 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-86e7c47a-c06d-4c81-b029-a5fdf64bb9f9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:02.427922 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-86e7c47a-c06d-4c81-b029-a5fdf64bb9f9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:02.434822 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-86e7c47a-c06d-4c81-b029-a5fdf64bb9f9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1221 microversion: 2.1 time: 0.081004 Jun 20 18:48:02.435436 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 99/213] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:02 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:02.496977 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-648516237", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:48:02.559372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.network.neutron [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] validate_networks() for [('619214b4-923a-4887-a5d4-59de0868e3a9', None, None, None, None, None)] {{(pid=124190) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:48:03.101641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a0705eb8-6ea7-4947-be74-e139ebb7c82e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:03.102428 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a0705eb8-6ea7-4947-be74-e139ebb7c82e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:03.118732 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a0705eb8-6ea7-4947-be74-e139ebb7c82e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:03.120043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a0705eb8-6ea7-4947-be74-e139ebb7c82e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:03.122521 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a0705eb8-6ea7-4947-be74-e139ebb7c82e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:03.124382 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a0705eb8-6ea7-4947-be74-e139ebb7c82e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:03.318695 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a0705eb8-6ea7-4947-be74-e139ebb7c82e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:03.339245 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a0705eb8-6ea7-4947-be74-e139ebb7c82e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1318 microversion: 2.1 time: 0.242543 Jun 20 18:48:03.342373 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 100/214] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:03 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:48:03.365989 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Flavor limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:48:03.366465 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Image limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:48:03.368818 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Flavor pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:48:03.370905 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-4d889a6a-f01c-4c04-b78d-3439473d5cdc req-91412ccd-e8be-42a0-9e71-1e094a6c3c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8a1109-c502-4228-836f-6ed4a63e6555", "tag": "420fee3e-2248-4c0d-b858-70fade6db5da"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:48:03.371926 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Image pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:48:03.372620 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:48:03.389987 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-4d889a6a-f01c-4c04-b78d-3439473d5cdc req-91412ccd-e8be-42a0-9e71-1e094a6c3c07 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:03.391254 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-4d889a6a-f01c-4c04-b78d-3439473d5cdc req-91412ccd-e8be-42a0-9e71-1e094a6c3c07 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:03.419527 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:03.420286 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:03.422287 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-4d889a6a-f01c-4c04-b78d-3439473d5cdc req-91412ccd-e8be-42a0-9e71-1e094a6c3c07 service nova] Creating event network-changed:420fee3e-2248-4c0d-b858-70fade6db5da for instance 0d8a1109-c502-4228-836f-6ed4a63e6555 on hv-cinder-83697 Jun 20 18:48:03.423831 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:03.425351 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:03.449711 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-4d889a6a-f01c-4c04-b78d-3439473d5cdc req-91412ccd-e8be-42a0-9e71-1e094a6c3c07 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080707 Jun 20 18:48:03.452522 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 101/215] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:48:03.478508 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Getting quotas for project 7b4a919be31b4c74a3197d98ecec7fde. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:48:03.484456 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Getting quotas for user 31fed190cac24d1b8326425f737e220b and project 7b4a919be31b4c74a3197d98ecec7fde. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:48:03.504450 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Going to run 1 instances... {{(pid=124190) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:48:03.507601 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124190) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:48:03.602235 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c97de19c-f738-45de-ba65-449cc5d3dc6a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.110123 Jun 20 18:48:03.603894 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 115/216] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:48:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:48:03.614852 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f7dd8fdb-caa4-41b1-bf93-3fa552410c54 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:03.615809 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f7dd8fdb-caa4-41b1-bf93-3fa552410c54 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:03.911369 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f7dd8fdb-caa4-41b1-bf93-3fa552410c54 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:03.922723 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f7dd8fdb-caa4-41b1-bf93-3fa552410c54 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1221 microversion: 2.1 time: 0.312048 Jun 20 18:48:03.933051 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 102/217] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:03 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1221 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:04.360578 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-81784a40-e653-46b3-b871-c92ce06acd22 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:04.361895 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-81784a40-e653-46b3-b871-c92ce06acd22 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:04.381368 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-81784a40-e653-46b3-b871-c92ce06acd22 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:04.382048 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-81784a40-e653-46b3-b871-c92ce06acd22 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:04.382643 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-81784a40-e653-46b3-b871-c92ce06acd22 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:04.383120 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-81784a40-e653-46b3-b871-c92ce06acd22 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:04.625367 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-81784a40-e653-46b3-b871-c92ce06acd22 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:04.638445 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-81784a40-e653-46b3-b871-c92ce06acd22 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1318 microversion: 2.1 time: 0.283348 Jun 20 18:48:04.639107 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 116/218] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:04 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:04.939834 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-beef5840-ccb9-44fb-8873-d04b73da7198 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:04.940446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-beef5840-ccb9-44fb-8873-d04b73da7198 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:04.949490 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-beef5840-ccb9-44fb-8873-d04b73da7198 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:04.953780 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-beef5840-ccb9-44fb-8873-d04b73da7198 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:04.954609 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-beef5840-ccb9-44fb-8873-d04b73da7198 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:04.958632 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-beef5840-ccb9-44fb-8873-d04b73da7198 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:05.089104 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-beef5840-ccb9-44fb-8873-d04b73da7198 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:05.104634 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-beef5840-ccb9-44fb-8873-d04b73da7198 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1217 microversion: 2.1 time: 0.166746 Jun 20 18:48:05.106892 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 103/219] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:04 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:05.657190 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-fcefc0a4-0be6-4720-af9e-55e2efe088ae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:05.657806 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-fcefc0a4-0be6-4720-af9e-55e2efe088ae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:05.665389 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fcefc0a4-0be6-4720-af9e-55e2efe088ae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:05.665849 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fcefc0a4-0be6-4720-af9e-55e2efe088ae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:05.666621 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fcefc0a4-0be6-4720-af9e-55e2efe088ae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:05.670629 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fcefc0a4-0be6-4720-af9e-55e2efe088ae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:05.851950 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-fcefc0a4-0be6-4720-af9e-55e2efe088ae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:05.863590 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-fcefc0a4-0be6-4720-af9e-55e2efe088ae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1318 microversion: 2.1 time: 0.210973 Jun 20 18:48:05.864316 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 117/220] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:05 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:06.122601 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8f62aa86-d0b7-45f0-97b5-307fc9b368a4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:06.123249 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8f62aa86-d0b7-45f0-97b5-307fc9b368a4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:06.130200 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8f62aa86-d0b7-45f0-97b5-307fc9b368a4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:06.130650 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8f62aa86-d0b7-45f0-97b5-307fc9b368a4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:06.131441 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8f62aa86-d0b7-45f0-97b5-307fc9b368a4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:06.131877 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8f62aa86-d0b7-45f0-97b5-307fc9b368a4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:06.192943 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8f62aa86-d0b7-45f0-97b5-307fc9b368a4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:06.200135 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8f62aa86-d0b7-45f0-97b5-307fc9b368a4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1217 microversion: 2.1 time: 0.081321 Jun 20 18:48:06.200698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 104/221] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:06 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:06.880524 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c4f09ff8-960d-4c2c-85ee-81b15fcab764 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:06.881182 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c4f09ff8-960d-4c2c-85ee-81b15fcab764 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:06.887166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c4f09ff8-960d-4c2c-85ee-81b15fcab764 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:06.887677 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c4f09ff8-960d-4c2c-85ee-81b15fcab764 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:06.888495 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c4f09ff8-960d-4c2c-85ee-81b15fcab764 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:06.888988 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c4f09ff8-960d-4c2c-85ee-81b15fcab764 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:07.023434 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c4f09ff8-960d-4c2c-85ee-81b15fcab764 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:07.030993 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c4f09ff8-960d-4c2c-85ee-81b15fcab764 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1318 microversion: 2.1 time: 0.154264 Jun 20 18:48:07.031697 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 118/222] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:06 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:07.219067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9238ccea-761b-49e0-9e5e-829766e4b474 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:07.219067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9238ccea-761b-49e0-9e5e-829766e4b474 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:07.224892 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9238ccea-761b-49e0-9e5e-829766e4b474 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:07.225422 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9238ccea-761b-49e0-9e5e-829766e4b474 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:07.226262 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9238ccea-761b-49e0-9e5e-829766e4b474 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:07.226927 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9238ccea-761b-49e0-9e5e-829766e4b474 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:07.290470 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9238ccea-761b-49e0-9e5e-829766e4b474 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:07.299056 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9238ccea-761b-49e0-9e5e-829766e4b474 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1217 microversion: 2.1 time: 0.086119 Jun 20 18:48:07.299622 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 105/223] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:07 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:08.054987 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a0e9845f-432c-4b01-99c2-b1d14bd235e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:08.056156 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a0e9845f-432c-4b01-99c2-b1d14bd235e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:08.069744 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a0e9845f-432c-4b01-99c2-b1d14bd235e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:08.070112 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a0e9845f-432c-4b01-99c2-b1d14bd235e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:08.071151 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a0e9845f-432c-4b01-99c2-b1d14bd235e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:08.075823 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a0e9845f-432c-4b01-99c2-b1d14bd235e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:08.225436 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a0e9845f-432c-4b01-99c2-b1d14bd235e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:08.233499 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a0e9845f-432c-4b01-99c2-b1d14bd235e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1318 microversion: 2.1 time: 0.182245 Jun 20 18:48:08.234161 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 119/224] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:08 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:08.318118 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-354820f3-1290-4253-9de1-530236b88316 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:08.319811 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-354820f3-1290-4253-9de1-530236b88316 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:08.329087 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-354820f3-1290-4253-9de1-530236b88316 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:08.330013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-354820f3-1290-4253-9de1-530236b88316 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:08.331270 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-354820f3-1290-4253-9de1-530236b88316 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:08.331966 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-354820f3-1290-4253-9de1-530236b88316 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:08.424524 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-354820f3-1290-4253-9de1-530236b88316 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:08.431964 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-354820f3-1290-4253-9de1-530236b88316 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1217 microversion: 2.1 time: 0.119880 Jun 20 18:48:08.432854 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 106/225] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:08 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:09.251748 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f4dff17b-39e7-44d7-94f7-860e362f4de8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:09.253401 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f4dff17b-39e7-44d7-94f7-860e362f4de8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:09.255721 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:09.262867 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f4dff17b-39e7-44d7-94f7-860e362f4de8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:09.263471 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f4dff17b-39e7-44d7-94f7-860e362f4de8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:09.264458 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f4dff17b-39e7-44d7-94f7-860e362f4de8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:09.264957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f4dff17b-39e7-44d7-94f7-860e362f4de8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:09.433298 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f4dff17b-39e7-44d7-94f7-860e362f4de8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:09.446083 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f4dff17b-39e7-44d7-94f7-860e362f4de8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1318 microversion: 2.1 time: 0.199227 Jun 20 18:48:09.456209 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-059e3b1a-20b1-4aac-a057-94437a96c67c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:09.456209 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-059e3b1a-20b1-4aac-a057-94437a96c67c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:09.458190 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 120/226] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:09 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:09.458773 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:09.460270 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:09.466218 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-059e3b1a-20b1-4aac-a057-94437a96c67c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:09.467301 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-059e3b1a-20b1-4aac-a057-94437a96c67c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:09.468852 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-059e3b1a-20b1-4aac-a057-94437a96c67c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:09.469471 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-059e3b1a-20b1-4aac-a057-94437a96c67c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:09.477772 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=77 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:09.628706 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-059e3b1a-20b1-4aac-a057-94437a96c67c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:09.637448 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-059e3b1a-20b1-4aac-a057-94437a96c67c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1279 microversion: 2.1 time: 0.191204 Jun 20 18:48:09.638198 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 107/227] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:09 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1279 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:48:10.025714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-c802449d-dc4a-4f80-bffc-5ead60750d5b req-5e6c4551-f625-4de6-8a03-bf67598183dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a86d158-0870-4597-be67-25d4f9371977", "tag": "a5d21488-01bf-4805-bcda-afe09b1d3562"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:48:10.044446 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-c802449d-dc4a-4f80-bffc-5ead60750d5b req-5e6c4551-f625-4de6-8a03-bf67598183dd service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:10.045147 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-c802449d-dc4a-4f80-bffc-5ead60750d5b req-5e6c4551-f625-4de6-8a03-bf67598183dd service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:10.058621 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-c802449d-dc4a-4f80-bffc-5ead60750d5b req-5e6c4551-f625-4de6-8a03-bf67598183dd service nova] Creating event network-changed:a5d21488-01bf-4805-bcda-afe09b1d3562 for instance 4a86d158-0870-4597-be67-25d4f9371977 on hv-cinder-83697 Jun 20 18:48:10.064052 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-c802449d-dc4a-4f80-bffc-5ead60750d5b req-5e6c4551-f625-4de6-8a03-bf67598183dd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042538 Jun 20 18:48:10.065654 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 121/228] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:48:10.463683 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a67d8e08-13d3-461c-8bf3-3109f21be13b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:10.464285 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a67d8e08-13d3-461c-8bf3-3109f21be13b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:10.472010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a67d8e08-13d3-461c-8bf3-3109f21be13b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:10.472884 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a67d8e08-13d3-461c-8bf3-3109f21be13b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:10.473743 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a67d8e08-13d3-461c-8bf3-3109f21be13b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:10.474159 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a67d8e08-13d3-461c-8bf3-3109f21be13b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:10.661568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d0b2e7c2-f068-41fb-80b1-3f7885a8876c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:10.664202 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d0b2e7c2-f068-41fb-80b1-3f7885a8876c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:10.676119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d0b2e7c2-f068-41fb-80b1-3f7885a8876c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:10.676818 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d0b2e7c2-f068-41fb-80b1-3f7885a8876c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:10.678012 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d0b2e7c2-f068-41fb-80b1-3f7885a8876c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:10.678680 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d0b2e7c2-f068-41fb-80b1-3f7885a8876c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:10.772738 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d0b2e7c2-f068-41fb-80b1-3f7885a8876c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:10.784934 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d0b2e7c2-f068-41fb-80b1-3f7885a8876c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1279 microversion: 2.1 time: 0.132605 Jun 20 18:48:10.796922 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 122/229] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:10 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1279 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:10.852268 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a67d8e08-13d3-461c-8bf3-3109f21be13b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:10.860642 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a67d8e08-13d3-461c-8bf3-3109f21be13b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1318 microversion: 2.1 time: 0.400756 Jun 20 18:48:10.861830 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 108/230] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:10 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:11.234684 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-37c8b8de-0df7-4d62-b97b-cf7f4a57c31d req-7ec5eee5-391b-42e4-bd64-9bcc52a11917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8a1109-c502-4228-836f-6ed4a63e6555", "name": "network-vif-plugged", "status": "completed", "tag": "420fee3e-2248-4c0d-b858-70fade6db5da"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:48:11.243653 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-37c8b8de-0df7-4d62-b97b-cf7f4a57c31d req-7ec5eee5-391b-42e4-bd64-9bcc52a11917 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:11.244289 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-37c8b8de-0df7-4d62-b97b-cf7f4a57c31d req-7ec5eee5-391b-42e4-bd64-9bcc52a11917 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:11.257060 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-37c8b8de-0df7-4d62-b97b-cf7f4a57c31d req-7ec5eee5-391b-42e4-bd64-9bcc52a11917 service nova] Creating event network-vif-plugged:420fee3e-2248-4c0d-b858-70fade6db5da for instance 0d8a1109-c502-4228-836f-6ed4a63e6555 on hv-cinder-83697 Jun 20 18:48:11.263105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-37c8b8de-0df7-4d62-b97b-cf7f4a57c31d req-7ec5eee5-391b-42e4-bd64-9bcc52a11917 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032750 Jun 20 18:48:11.265333 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 123/231] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:48:11.803012 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fbae5a02-1f38-41ca-ad31-faa81417160e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:11.803608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fbae5a02-1f38-41ca-ad31-faa81417160e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:11.810207 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fbae5a02-1f38-41ca-ad31-faa81417160e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:11.810651 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fbae5a02-1f38-41ca-ad31-faa81417160e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:11.811441 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fbae5a02-1f38-41ca-ad31-faa81417160e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:11.811917 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fbae5a02-1f38-41ca-ad31-faa81417160e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:11.878104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-01c4df94-f12b-407c-b122-f8e460a28650 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:11.878795 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-01c4df94-f12b-407c-b122-f8e460a28650 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:11.885329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-01c4df94-f12b-407c-b122-f8e460a28650 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:11.885773 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-01c4df94-f12b-407c-b122-f8e460a28650 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:11.886537 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-01c4df94-f12b-407c-b122-f8e460a28650 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:11.886993 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-01c4df94-f12b-407c-b122-f8e460a28650 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:12.020103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-01c4df94-f12b-407c-b122-f8e460a28650 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:12.027632 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-01c4df94-f12b-407c-b122-f8e460a28650 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1318 microversion: 2.1 time: 0.153709 Jun 20 18:48:12.028200 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 124/232] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:11 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:12.110040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fbae5a02-1f38-41ca-ad31-faa81417160e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:12.118066 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fbae5a02-1f38-41ca-ad31-faa81417160e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1321 microversion: 2.1 time: 0.318907 Jun 20 18:48:12.118633 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 109/233] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:11 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:12.577786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-4855def7-a380-4ce5-b367-2624d504d434 req-e9340301-1fdf-4f0a-8bda-56a281a51714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d", "tag": "1f9e0457-eeee-4812-84ac-eeb566b3e205"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:48:12.590224 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-4855def7-a380-4ce5-b367-2624d504d434 req-e9340301-1fdf-4f0a-8bda-56a281a51714 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:12.590678 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-4855def7-a380-4ce5-b367-2624d504d434 req-e9340301-1fdf-4f0a-8bda-56a281a51714 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:12.602621 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-4855def7-a380-4ce5-b367-2624d504d434 req-e9340301-1fdf-4f0a-8bda-56a281a51714 service nova] Creating event network-changed:1f9e0457-eeee-4812-84ac-eeb566b3e205 for instance 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d on hv-cinder-83697 Jun 20 18:48:12.609428 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-4855def7-a380-4ce5-b367-2624d504d434 req-e9340301-1fdf-4f0a-8bda-56a281a51714 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034824 Jun 20 18:48:12.610327 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 125/234] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:48:13.044695 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-316b123a-c402-4358-ad1e-3b3a11c9dcf2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:13.045309 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-316b123a-c402-4358-ad1e-3b3a11c9dcf2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:13.052299 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-316b123a-c402-4358-ad1e-3b3a11c9dcf2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:13.052739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-316b123a-c402-4358-ad1e-3b3a11c9dcf2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:13.053677 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-316b123a-c402-4358-ad1e-3b3a11c9dcf2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:13.054283 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-316b123a-c402-4358-ad1e-3b3a11c9dcf2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:13.135464 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-982964f3-918f-47eb-bd92-9241eb6c6bbf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:13.137277 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-982964f3-918f-47eb-bd92-9241eb6c6bbf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:13.145494 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-982964f3-918f-47eb-bd92-9241eb6c6bbf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:13.146190 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-982964f3-918f-47eb-bd92-9241eb6c6bbf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:13.147025 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-982964f3-918f-47eb-bd92-9241eb6c6bbf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:13.147684 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-982964f3-918f-47eb-bd92-9241eb6c6bbf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:13.217491 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-316b123a-c402-4358-ad1e-3b3a11c9dcf2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:13.226970 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-316b123a-c402-4358-ad1e-3b3a11c9dcf2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1318 microversion: 2.1 time: 0.186377 Jun 20 18:48:13.227674 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 110/235] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:13 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:13.367189 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-982964f3-918f-47eb-bd92-9241eb6c6bbf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:13.375492 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-982964f3-918f-47eb-bd92-9241eb6c6bbf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1321 microversion: 2.1 time: 0.244220 Jun 20 18:48:13.376058 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 126/236] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:13 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:14.243988 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c854dccc-a27f-4f81-aeca-7d9ad1812a68 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:14.244602 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c854dccc-a27f-4f81-aeca-7d9ad1812a68 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:14.246511 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=10 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:14.253716 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c854dccc-a27f-4f81-aeca-7d9ad1812a68 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:14.254170 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c854dccc-a27f-4f81-aeca-7d9ad1812a68 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:14.254977 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c854dccc-a27f-4f81-aeca-7d9ad1812a68 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:14.255421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c854dccc-a27f-4f81-aeca-7d9ad1812a68 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:14.389563 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=4 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:14.391448 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=14 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:14.399397 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-99fd925f-f193-4e77-9247-c05004f32a36 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:14.400017 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-99fd925f-f193-4e77-9247-c05004f32a36 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:14.410226 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-99fd925f-f193-4e77-9247-c05004f32a36 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:14.410683 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-99fd925f-f193-4e77-9247-c05004f32a36 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:14.411644 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-99fd925f-f193-4e77-9247-c05004f32a36 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:14.412201 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-99fd925f-f193-4e77-9247-c05004f32a36 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:14.423279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c854dccc-a27f-4f81-aeca-7d9ad1812a68 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:14.440478 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c854dccc-a27f-4f81-aeca-7d9ad1812a68 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1318 microversion: 2.1 time: 0.200093 Jun 20 18:48:14.443839 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 111/237] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:14 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:14.565205 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-99fd925f-f193-4e77-9247-c05004f32a36 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:14.572929 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-99fd925f-f193-4e77-9247-c05004f32a36 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1321 microversion: 2.1 time: 0.184216 Jun 20 18:48:14.573488 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 127/238] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:14 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:48:15.463766 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b6e4252a-2018-408f-8d52-2f114917b067 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:15.465202 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b6e4252a-2018-408f-8d52-2f114917b067 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:15.477277 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b6e4252a-2018-408f-8d52-2f114917b067 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:15.478508 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b6e4252a-2018-408f-8d52-2f114917b067 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:15.480435 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b6e4252a-2018-408f-8d52-2f114917b067 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:15.482715 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b6e4252a-2018-408f-8d52-2f114917b067 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:15.595842 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-19e7bc52-2407-42ae-bad1-14e7235a3a8d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:15.597335 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-19e7bc52-2407-42ae-bad1-14e7235a3a8d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:15.613213 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-19e7bc52-2407-42ae-bad1-14e7235a3a8d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:15.614071 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-19e7bc52-2407-42ae-bad1-14e7235a3a8d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:15.614849 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-19e7bc52-2407-42ae-bad1-14e7235a3a8d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:15.615311 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-19e7bc52-2407-42ae-bad1-14e7235a3a8d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:15.739366 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b6e4252a-2018-408f-8d52-2f114917b067 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:15.750759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b6e4252a-2018-408f-8d52-2f114917b067 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1318 microversion: 2.1 time: 0.293967 Jun 20 18:48:15.751838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 112/239] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:15 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:48:16.012712 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-19e7bc52-2407-42ae-bad1-14e7235a3a8d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:16.020261 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-19e7bc52-2407-42ae-bad1-14e7235a3a8d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1321 microversion: 2.1 time: 0.430701 Jun 20 18:48:16.020934 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 128/240] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:15 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:16.769290 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-98f4cddf-da5b-49df-9c5f-ed937d6ae35b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:16.770416 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-98f4cddf-da5b-49df-9c5f-ed937d6ae35b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:16.781181 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-98f4cddf-da5b-49df-9c5f-ed937d6ae35b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:16.783794 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-98f4cddf-da5b-49df-9c5f-ed937d6ae35b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:16.785271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-98f4cddf-da5b-49df-9c5f-ed937d6ae35b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:16.787962 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-98f4cddf-da5b-49df-9c5f-ed937d6ae35b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:17.037917 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a4ae2a1a-8141-4c65-8539-25473077b107 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:17.038605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a4ae2a1a-8141-4c65-8539-25473077b107 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:17.047372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a4ae2a1a-8141-4c65-8539-25473077b107 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:17.051208 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a4ae2a1a-8141-4c65-8539-25473077b107 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:17.052237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a4ae2a1a-8141-4c65-8539-25473077b107 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:17.052821 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a4ae2a1a-8141-4c65-8539-25473077b107 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:17.217076 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-98f4cddf-da5b-49df-9c5f-ed937d6ae35b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:17.226724 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-98f4cddf-da5b-49df-9c5f-ed937d6ae35b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1318 microversion: 2.1 time: 0.462270 Jun 20 18:48:17.231978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 113/241] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:16 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:17.489311 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a4ae2a1a-8141-4c65-8539-25473077b107 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:17.502360 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a4ae2a1a-8141-4c65-8539-25473077b107 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1321 microversion: 2.1 time: 0.468581 Jun 20 18:48:17.515897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 129/242] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:17 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1321 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:48:18.250701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-652eee3a-71a7-49d0-a652-15be7ba4486c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:18.251919 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-652eee3a-71a7-49d0-a652-15be7ba4486c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:18.262096 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-652eee3a-71a7-49d0-a652-15be7ba4486c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:18.263120 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-652eee3a-71a7-49d0-a652-15be7ba4486c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:18.263716 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-652eee3a-71a7-49d0-a652-15be7ba4486c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:18.264304 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-652eee3a-71a7-49d0-a652-15be7ba4486c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:18.529938 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f83dab92-c57e-4161-b99d-622f64efb8f7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:18.531295 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f83dab92-c57e-4161-b99d-622f64efb8f7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:18.551358 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f83dab92-c57e-4161-b99d-622f64efb8f7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:18.552062 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f83dab92-c57e-4161-b99d-622f64efb8f7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:18.553627 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f83dab92-c57e-4161-b99d-622f64efb8f7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:18.554874 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f83dab92-c57e-4161-b99d-622f64efb8f7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:18.664849 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-652eee3a-71a7-49d0-a652-15be7ba4486c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:18.675713 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-652eee3a-71a7-49d0-a652-15be7ba4486c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1506 microversion: 2.1 time: 0.429495 Jun 20 18:48:18.676291 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 114/243] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:18 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:18.755444 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f83dab92-c57e-4161-b99d-622f64efb8f7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:18.764465 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f83dab92-c57e-4161-b99d-622f64efb8f7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1321 microversion: 2.1 time: 0.241314 Jun 20 18:48:18.766014 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 130/244] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:18 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:48:19.781933 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-2512daf3-d41c-4daf-adf8-29adf064da4b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:19.782541 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-2512daf3-d41c-4daf-adf8-29adf064da4b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:19.807675 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2512daf3-d41c-4daf-adf8-29adf064da4b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:19.809332 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2512daf3-d41c-4daf-adf8-29adf064da4b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:19.810358 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2512daf3-d41c-4daf-adf8-29adf064da4b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:19.811882 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2512daf3-d41c-4daf-adf8-29adf064da4b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:20.260199 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-2512daf3-d41c-4daf-adf8-29adf064da4b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:20.268479 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-2512daf3-d41c-4daf-adf8-29adf064da4b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1321 microversion: 2.1 time: 0.490620 Jun 20 18:48:20.269873 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 115/245] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:19 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:20.755096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-f94c3964-7c6b-48f2-be65-185dd83aeae2 req-3f2092a1-f5c2-445d-aa04-af466a3d9038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a86d158-0870-4597-be67-25d4f9371977", "name": "network-vif-plugged", "status": "completed", "tag": "a5d21488-01bf-4805-bcda-afe09b1d3562"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:48:20.770142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-f94c3964-7c6b-48f2-be65-185dd83aeae2 req-3f2092a1-f5c2-445d-aa04-af466a3d9038 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:20.773291 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-f94c3964-7c6b-48f2-be65-185dd83aeae2 req-3f2092a1-f5c2-445d-aa04-af466a3d9038 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:20.800000 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-f94c3964-7c6b-48f2-be65-185dd83aeae2 req-3f2092a1-f5c2-445d-aa04-af466a3d9038 service nova] Creating event network-vif-plugged:a5d21488-01bf-4805-bcda-afe09b1d3562 for instance 4a86d158-0870-4597-be67-25d4f9371977 on hv-cinder-83697 Jun 20 18:48:20.810756 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-f94c3964-7c6b-48f2-be65-185dd83aeae2 req-3f2092a1-f5c2-445d-aa04-af466a3d9038 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058989 Jun 20 18:48:20.818639 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 131/246] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:48:21.286726 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0bacd29b-a285-4c68-a680-6302806c8d1e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:21.288056 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0bacd29b-a285-4c68-a680-6302806c8d1e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:21.296888 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0bacd29b-a285-4c68-a680-6302806c8d1e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:21.297871 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0bacd29b-a285-4c68-a680-6302806c8d1e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:21.299263 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0bacd29b-a285-4c68-a680-6302806c8d1e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:21.299907 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0bacd29b-a285-4c68-a680-6302806c8d1e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:21.388341 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-317d0341-ee2a-4418-9b80-3026cc2fe8ae tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Action: 'create', calling method: .version_select at 0x7f7e454b3550>, body: {"keypair": {"name": "tempest-TestShelveInstance-997547484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtkOd47whWxYYTJR6WghBQ/HTGlHpJq5wIU4m+sy70EMVh1fSwQ7Osf9f0p0RMWxKwMW1OoTyB6ihnz+iQDL5zTuph5vKbVrUaz5thuxf4wgArswI0HOHVpGXjRW7zKEg=="}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:48:21.417094 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-317d0341-ee2a-4418-9b80-3026cc2fe8ae tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Getting quotas for project afb8f33898e2408eaaac28b7f1802314. Resources: {'key_pairs'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:48:21.421783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-317d0341-ee2a-4418-9b80-3026cc2fe8ae tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Getting quotas for user a5d3b9702e434e038466969abfae2338 and project afb8f33898e2408eaaac28b7f1802314. Resources: {'key_pairs'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:48:21.498709 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-317d0341-ee2a-4418-9b80-3026cc2fe8ae tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.355141 Jun 20 18:48:21.500339 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 116/247] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jun 20 18:48:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:48:21.548435 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0bacd29b-a285-4c68-a680-6302806c8d1e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:21.573221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0bacd29b-a285-4c68-a680-6302806c8d1e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1321 microversion: 2.1 time: 0.291000 Jun 20 18:48:21.573809 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 132/248] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:21 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:48:22.590430 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0bcb9be1-352c-436e-954a-66d4d52cef08 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:22.591643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0bcb9be1-352c-436e-954a-66d4d52cef08 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:22.601399 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0bcb9be1-352c-436e-954a-66d4d52cef08 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:22.602830 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0bcb9be1-352c-436e-954a-66d4d52cef08 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:22.604545 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0bcb9be1-352c-436e-954a-66d4d52cef08 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:22.605174 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0bcb9be1-352c-436e-954a-66d4d52cef08 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:22.793848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0bcb9be1-352c-436e-954a-66d4d52cef08 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:22.805658 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0bcb9be1-352c-436e-954a-66d4d52cef08 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1321 microversion: 2.1 time: 0.219319 Jun 20 18:48:22.806504 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 117/249] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:22 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:23.828003 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-74b648d0-a5db-4760-9c79-d3a9d6036942 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:23.828551 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-74b648d0-a5db-4760-9c79-d3a9d6036942 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:23.835321 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-74b648d0-a5db-4760-9c79-d3a9d6036942 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:23.835770 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-74b648d0-a5db-4760-9c79-d3a9d6036942 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:23.836539 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-74b648d0-a5db-4760-9c79-d3a9d6036942 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:23.836976 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-74b648d0-a5db-4760-9c79-d3a9d6036942 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:23.975245 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-74b648d0-a5db-4760-9c79-d3a9d6036942 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:23.982635 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-74b648d0-a5db-4760-9c79-d3a9d6036942 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1321 microversion: 2.1 time: 0.159930 Jun 20 18:48:23.983286 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 133/250] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:23 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:24.280767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-96648d65-4677-4eb3-bbbb-12a7135035cb req-82292721-885f-4d57-b049-c35607c337a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d", "name": "network-vif-plugged", "status": "completed", "tag": "1f9e0457-eeee-4812-84ac-eeb566b3e205"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:48:24.295366 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-96648d65-4677-4eb3-bbbb-12a7135035cb req-82292721-885f-4d57-b049-c35607c337a8 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:24.296313 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-96648d65-4677-4eb3-bbbb-12a7135035cb req-82292721-885f-4d57-b049-c35607c337a8 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:24.319639 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-96648d65-4677-4eb3-bbbb-12a7135035cb req-82292721-885f-4d57-b049-c35607c337a8 service nova] Creating event network-vif-plugged:1f9e0457-eeee-4812-84ac-eeb566b3e205 for instance 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d on hv-cinder-83697 Jun 20 18:48:24.324865 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-96648d65-4677-4eb3-bbbb-12a7135035cb req-82292721-885f-4d57-b049-c35607c337a8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049393 Jun 20 18:48:24.334423 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 118/251] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:48:24.999763 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e1a5bc46-6c12-4d27-b699-50ef63e717d8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:25.000367 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e1a5bc46-6c12-4d27-b699-50ef63e717d8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:25.007212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e1a5bc46-6c12-4d27-b699-50ef63e717d8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:25.007665 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e1a5bc46-6c12-4d27-b699-50ef63e717d8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:25.008449 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e1a5bc46-6c12-4d27-b699-50ef63e717d8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:25.008886 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e1a5bc46-6c12-4d27-b699-50ef63e717d8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:25.029754 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=100 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:25.147596 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e1a5bc46-6c12-4d27-b699-50ef63e717d8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:25.156064 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e1a5bc46-6c12-4d27-b699-50ef63e717d8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1321 microversion: 2.1 time: 0.159500 Jun 20 18:48:25.156710 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 134/252] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:24 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:26.173299 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5ef66417-5d3b-43fd-9fc0-bfe85a20b07b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:26.174836 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5ef66417-5d3b-43fd-9fc0-bfe85a20b07b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:26.181959 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5ef66417-5d3b-43fd-9fc0-bfe85a20b07b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:26.182559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5ef66417-5d3b-43fd-9fc0-bfe85a20b07b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:26.183486 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5ef66417-5d3b-43fd-9fc0-bfe85a20b07b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:26.184154 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5ef66417-5d3b-43fd-9fc0-bfe85a20b07b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:26.343424 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5ef66417-5d3b-43fd-9fc0-bfe85a20b07b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:26.352900 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5ef66417-5d3b-43fd-9fc0-bfe85a20b07b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1321 microversion: 2.1 time: 0.184156 Jun 20 18:48:26.353634 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 119/253] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:26 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:27.375577 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-da9c955e-4563-42d4-9d22-355caab385fc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:27.376870 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-da9c955e-4563-42d4-9d22-355caab385fc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:27.384747 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-da9c955e-4563-42d4-9d22-355caab385fc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:27.385189 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-da9c955e-4563-42d4-9d22-355caab385fc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:27.385948 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-da9c955e-4563-42d4-9d22-355caab385fc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:27.386374 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-da9c955e-4563-42d4-9d22-355caab385fc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:27.532029 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-da9c955e-4563-42d4-9d22-355caab385fc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:27.540667 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-da9c955e-4563-42d4-9d22-355caab385fc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1515 microversion: 2.1 time: 0.174028 Jun 20 18:48:27.541390 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 135/254] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:27 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:27.558141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-53d77e5e-a9c9-447e-a22b-0fd073885a09 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:48:27.559111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-53d77e5e-a9c9-447e-a22b-0fd073885a09 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:27.566857 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-53d77e5e-a9c9-447e-a22b-0fd073885a09 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:27.567331 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-53d77e5e-a9c9-447e-a22b-0fd073885a09 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:27.568086 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-53d77e5e-a9c9-447e-a22b-0fd073885a09 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:27.568511 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-53d77e5e-a9c9-447e-a22b-0fd073885a09 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:27.597782 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-53d77e5e-a9c9-447e-a22b-0fd073885a09 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lazy-loading 'flavor' on Instance uuid 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:48:27.737758 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-53d77e5e-a9c9-447e-a22b-0fd073885a09 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "POST /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d/action" status: 200 len: 32 microversion: 2.1 time: 0.183537 Jun 20 18:48:27.738358 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 120/255] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jun 20 18:48:27 2022] POST /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 18:48:27.754070 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-25d981fa-5e1d-4138-9a43-adc6b0e65def tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:27.755180 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-25d981fa-5e1d-4138-9a43-adc6b0e65def tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:27.761570 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-25d981fa-5e1d-4138-9a43-adc6b0e65def tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:27.762270 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-25d981fa-5e1d-4138-9a43-adc6b0e65def tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:27.763414 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-25d981fa-5e1d-4138-9a43-adc6b0e65def tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:27.764076 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-25d981fa-5e1d-4138-9a43-adc6b0e65def tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:27.920545 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-25d981fa-5e1d-4138-9a43-adc6b0e65def tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:27.929224 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-25d981fa-5e1d-4138-9a43-adc6b0e65def tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.185874 Jun 20 18:48:27.929922 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 136/256] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:27 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:48:28.948046 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6dfaa235-f920-4da9-85c5-b6699d568944 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:28.948742 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6dfaa235-f920-4da9-85c5-b6699d568944 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:28.956378 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6dfaa235-f920-4da9-85c5-b6699d568944 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:28.956830 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6dfaa235-f920-4da9-85c5-b6699d568944 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:28.957590 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6dfaa235-f920-4da9-85c5-b6699d568944 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:28.958053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6dfaa235-f920-4da9-85c5-b6699d568944 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:29.111130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6dfaa235-f920-4da9-85c5-b6699d568944 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:29.118903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6dfaa235-f920-4da9-85c5-b6699d568944 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.177024 Jun 20 18:48:29.119456 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 121/257] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:28 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:30.136140 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a58e0e9a-6aea-4d65-bb6d-0d5d948a7c41 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:30.136765 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a58e0e9a-6aea-4d65-bb6d-0d5d948a7c41 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:30.142709 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a58e0e9a-6aea-4d65-bb6d-0d5d948a7c41 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:30.143192 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a58e0e9a-6aea-4d65-bb6d-0d5d948a7c41 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:30.144050 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a58e0e9a-6aea-4d65-bb6d-0d5d948a7c41 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:30.144478 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a58e0e9a-6aea-4d65-bb6d-0d5d948a7c41 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:30.278639 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a58e0e9a-6aea-4d65-bb6d-0d5d948a7c41 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:30.286026 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a58e0e9a-6aea-4d65-bb6d-0d5d948a7c41 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.153701 Jun 20 18:48:30.286584 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 137/258] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:30 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:31.302955 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c4b33106-6e80-47d0-81a2-a3c1e0359b4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:31.303561 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c4b33106-6e80-47d0-81a2-a3c1e0359b4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:31.309992 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c4b33106-6e80-47d0-81a2-a3c1e0359b4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:31.310434 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c4b33106-6e80-47d0-81a2-a3c1e0359b4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:31.311220 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c4b33106-6e80-47d0-81a2-a3c1e0359b4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:31.311649 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c4b33106-6e80-47d0-81a2-a3c1e0359b4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:31.440980 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c4b33106-6e80-47d0-81a2-a3c1e0359b4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:31.443314 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=4 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:31.449788 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c4b33106-6e80-47d0-81a2-a3c1e0359b4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.150596 Jun 20 18:48:31.450346 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 122/259] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:31 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:32.466628 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1e0584ca-539e-4aa5-bf56-c4ee3e0946aa tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:32.467293 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1e0584ca-539e-4aa5-bf56-c4ee3e0946aa tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:32.473937 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1e0584ca-539e-4aa5-bf56-c4ee3e0946aa tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:32.474383 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1e0584ca-539e-4aa5-bf56-c4ee3e0946aa tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:32.475181 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1e0584ca-539e-4aa5-bf56-c4ee3e0946aa tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:32.475642 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1e0584ca-539e-4aa5-bf56-c4ee3e0946aa tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:32.604010 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-1e0584ca-539e-4aa5-bf56-c4ee3e0946aa tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:32.612058 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1e0584ca-539e-4aa5-bf56-c4ee3e0946aa tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.149341 Jun 20 18:48:32.612607 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 138/260] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:32 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:33.628732 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ef37616d-063c-4c46-977f-09c050f24cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:33.629419 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ef37616d-063c-4c46-977f-09c050f24cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:33.635807 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ef37616d-063c-4c46-977f-09c050f24cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:33.636246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ef37616d-063c-4c46-977f-09c050f24cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:33.636991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ef37616d-063c-4c46-977f-09c050f24cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:33.637464 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ef37616d-063c-4c46-977f-09c050f24cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:33.651813 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:33.799909 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ef37616d-063c-4c46-977f-09c050f24cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:33.807188 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ef37616d-063c-4c46-977f-09c050f24cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.182450 Jun 20 18:48:33.807746 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 123/261] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:33 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:34.824747 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a58f3074-6a30-4182-9489-11c5c1546f75 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:34.825973 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a58f3074-6a30-4182-9489-11c5c1546f75 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:34.833500 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a58f3074-6a30-4182-9489-11c5c1546f75 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:34.835089 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a58f3074-6a30-4182-9489-11c5c1546f75 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:34.835874 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a58f3074-6a30-4182-9489-11c5c1546f75 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:34.836485 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a58f3074-6a30-4182-9489-11c5c1546f75 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:35.008259 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a58f3074-6a30-4182-9489-11c5c1546f75 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:35.016468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a58f3074-6a30-4182-9489-11c5c1546f75 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.195513 Jun 20 18:48:35.026663 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 139/262] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:34 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:36.034133 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b35c0455-9e40-4820-889d-c802d6ce48b4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:36.034931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b35c0455-9e40-4820-889d-c802d6ce48b4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:36.046129 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b35c0455-9e40-4820-889d-c802d6ce48b4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:36.046739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b35c0455-9e40-4820-889d-c802d6ce48b4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:36.047732 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b35c0455-9e40-4820-889d-c802d6ce48b4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:36.048269 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b35c0455-9e40-4820-889d-c802d6ce48b4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:36.249467 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b35c0455-9e40-4820-889d-c802d6ce48b4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:36.262386 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b35c0455-9e40-4820-889d-c802d6ce48b4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.232082 Jun 20 18:48:36.262985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 124/263] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:36 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:37.281823 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-41b4d51d-12a3-4713-bdde-4260de47cb70 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:37.282668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-41b4d51d-12a3-4713-bdde-4260de47cb70 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:37.289190 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-41b4d51d-12a3-4713-bdde-4260de47cb70 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:37.289687 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-41b4d51d-12a3-4713-bdde-4260de47cb70 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:37.290656 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-41b4d51d-12a3-4713-bdde-4260de47cb70 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:37.291272 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-41b4d51d-12a3-4713-bdde-4260de47cb70 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:37.523300 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-41b4d51d-12a3-4713-bdde-4260de47cb70 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:37.533324 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-41b4d51d-12a3-4713-bdde-4260de47cb70 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.257967 Jun 20 18:48:37.545025 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 140/264] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:37 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:38.551491 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ef77aaa8-39f6-4b65-8ba8-899d63d8f7ae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:38.552170 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ef77aaa8-39f6-4b65-8ba8-899d63d8f7ae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:38.559853 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ef77aaa8-39f6-4b65-8ba8-899d63d8f7ae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:38.560302 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ef77aaa8-39f6-4b65-8ba8-899d63d8f7ae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:38.561354 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ef77aaa8-39f6-4b65-8ba8-899d63d8f7ae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:38.561793 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ef77aaa8-39f6-4b65-8ba8-899d63d8f7ae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:38.940174 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ef77aaa8-39f6-4b65-8ba8-899d63d8f7ae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:38.950000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ef77aaa8-39f6-4b65-8ba8-899d63d8f7ae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.402956 Jun 20 18:48:38.950554 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 125/265] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:38 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:39.968093 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-fb1c1ae2-b302-450a-bb3a-6e61514f6a2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:39.969249 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-fb1c1ae2-b302-450a-bb3a-6e61514f6a2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:39.971232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=42 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:39.980869 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fb1c1ae2-b302-450a-bb3a-6e61514f6a2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:39.981325 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fb1c1ae2-b302-450a-bb3a-6e61514f6a2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:39.982091 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fb1c1ae2-b302-450a-bb3a-6e61514f6a2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:39.982527 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fb1c1ae2-b302-450a-bb3a-6e61514f6a2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:40.135744 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-fb1c1ae2-b302-450a-bb3a-6e61514f6a2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:40.148342 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-fb1c1ae2-b302-450a-bb3a-6e61514f6a2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.184165 Jun 20 18:48:40.149151 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 141/266] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:39 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:41.168587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e860df2a-2115-4ce4-a9f4-2fc48321b8a6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:41.170397 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e860df2a-2115-4ce4-a9f4-2fc48321b8a6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:41.181554 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:41.184870 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e860df2a-2115-4ce4-a9f4-2fc48321b8a6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:41.185694 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e860df2a-2115-4ce4-a9f4-2fc48321b8a6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:41.188452 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e860df2a-2115-4ce4-a9f4-2fc48321b8a6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:41.189078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e860df2a-2115-4ce4-a9f4-2fc48321b8a6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:41.472204 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e860df2a-2115-4ce4-a9f4-2fc48321b8a6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:41.516494 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e860df2a-2115-4ce4-a9f4-2fc48321b8a6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.351985 Jun 20 18:48:41.525517 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 126/267] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:41 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:42.542017 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-374ccc6c-1d74-4c2e-82b9-ab818ed4ec62 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:42.542648 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-374ccc6c-1d74-4c2e-82b9-ab818ed4ec62 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:42.552413 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-374ccc6c-1d74-4c2e-82b9-ab818ed4ec62 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:42.555598 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-374ccc6c-1d74-4c2e-82b9-ab818ed4ec62 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:42.556452 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-374ccc6c-1d74-4c2e-82b9-ab818ed4ec62 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:42.556896 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-374ccc6c-1d74-4c2e-82b9-ab818ed4ec62 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:42.882831 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-374ccc6c-1d74-4c2e-82b9-ab818ed4ec62 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:42.898309 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-374ccc6c-1d74-4c2e-82b9-ab818ed4ec62 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.360089 Jun 20 18:48:42.903637 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 142/268] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:42 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:43.919555 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0cc90560-24c0-4f22-8423-df8ec6f1cd0a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:43.921244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0cc90560-24c0-4f22-8423-df8ec6f1cd0a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:43.928506 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0cc90560-24c0-4f22-8423-df8ec6f1cd0a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:43.928829 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0cc90560-24c0-4f22-8423-df8ec6f1cd0a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:43.929799 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0cc90560-24c0-4f22-8423-df8ec6f1cd0a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:43.930230 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0cc90560-24c0-4f22-8423-df8ec6f1cd0a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:44.085223 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0cc90560-24c0-4f22-8423-df8ec6f1cd0a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:44.093730 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0cc90560-24c0-4f22-8423-df8ec6f1cd0a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.177996 Jun 20 18:48:44.094332 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 127/269] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:43 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:45.110545 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-04ce570f-4759-4d99-9f66-87de995ef733 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:45.111456 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-04ce570f-4759-4d99-9f66-87de995ef733 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:45.119312 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-04ce570f-4759-4d99-9f66-87de995ef733 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:45.119778 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-04ce570f-4759-4d99-9f66-87de995ef733 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:45.120931 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-04ce570f-4759-4d99-9f66-87de995ef733 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:45.121544 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-04ce570f-4759-4d99-9f66-87de995ef733 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:45.282136 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-04ce570f-4759-4d99-9f66-87de995ef733 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:45.293721 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-04ce570f-4759-4d99-9f66-87de995ef733 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.187514 Jun 20 18:48:45.304630 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 143/270] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:45 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:46.311558 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9aab65d6-e03f-4253-8d2c-aa3ab22641d9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:46.312257 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9aab65d6-e03f-4253-8d2c-aa3ab22641d9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:46.324676 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9aab65d6-e03f-4253-8d2c-aa3ab22641d9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:46.325732 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9aab65d6-e03f-4253-8d2c-aa3ab22641d9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:46.326736 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9aab65d6-e03f-4253-8d2c-aa3ab22641d9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:46.327272 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9aab65d6-e03f-4253-8d2c-aa3ab22641d9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:46.471002 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9aab65d6-e03f-4253-8d2c-aa3ab22641d9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:46.479417 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9aab65d6-e03f-4253-8d2c-aa3ab22641d9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.171711 Jun 20 18:48:46.480578 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 128/271] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:46 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:47.497020 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-56e5bc47-fe10-471c-a439-db368979b24d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:47.497627 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-56e5bc47-fe10-471c-a439-db368979b24d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:47.510493 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-56e5bc47-fe10-471c-a439-db368979b24d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:47.510962 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-56e5bc47-fe10-471c-a439-db368979b24d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:47.511745 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-56e5bc47-fe10-471c-a439-db368979b24d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:47.514250 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-56e5bc47-fe10-471c-a439-db368979b24d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:47.771513 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-56e5bc47-fe10-471c-a439-db368979b24d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:47.798117 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-56e5bc47-fe10-471c-a439-db368979b24d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.304775 Jun 20 18:48:47.802665 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 144/272] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:47 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:48.817633 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-765c6a36-82ff-49dd-9e53-edf84a61b45c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:48.819515 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-765c6a36-82ff-49dd-9e53-edf84a61b45c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:48.826148 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-765c6a36-82ff-49dd-9e53-edf84a61b45c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:48.827164 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-765c6a36-82ff-49dd-9e53-edf84a61b45c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:48.827925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-765c6a36-82ff-49dd-9e53-edf84a61b45c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:48.828358 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-765c6a36-82ff-49dd-9e53-edf84a61b45c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:48.967995 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-765c6a36-82ff-49dd-9e53-edf84a61b45c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:48.976064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-765c6a36-82ff-49dd-9e53-edf84a61b45c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.162338 Jun 20 18:48:48.976827 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 129/273] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:48 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:50.006034 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d8c85061-3c38-4dd2-a29a-d72044e58864 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:50.007525 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d8c85061-3c38-4dd2-a29a-d72044e58864 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:50.013888 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d8c85061-3c38-4dd2-a29a-d72044e58864 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:50.014282 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d8c85061-3c38-4dd2-a29a-d72044e58864 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:50.015262 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d8c85061-3c38-4dd2-a29a-d72044e58864 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:50.015705 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d8c85061-3c38-4dd2-a29a-d72044e58864 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:50.178676 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d8c85061-3c38-4dd2-a29a-d72044e58864 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:50.188563 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d8c85061-3c38-4dd2-a29a-d72044e58864 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.199157 Jun 20 18:48:50.189140 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 145/274] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:49 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:51.206398 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-57353142-bc17-4449-816b-ab41a376035d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:51.207197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-57353142-bc17-4449-816b-ab41a376035d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:51.213844 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-57353142-bc17-4449-816b-ab41a376035d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:51.214356 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-57353142-bc17-4449-816b-ab41a376035d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:51.215210 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-57353142-bc17-4449-816b-ab41a376035d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:51.215705 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-57353142-bc17-4449-816b-ab41a376035d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:51.339962 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1a9c355e-0c63-45a9-b63f-c525fbee3d24 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8834734-54d4-4c44-8fb6-52fabadff232", "device": "/dev/sdb"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:48:51.342969 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1a9c355e-0c63-45a9-b63f-c525fbee3d24 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:51.350041 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1a9c355e-0c63-45a9-b63f-c525fbee3d24 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:51.350493 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1a9c355e-0c63-45a9-b63f-c525fbee3d24 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:51.351287 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1a9c355e-0c63-45a9-b63f-c525fbee3d24 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:51.352404 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1a9c355e-0c63-45a9-b63f-c525fbee3d24 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:51.368322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-57353142-bc17-4449-816b-ab41a376035d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:51.376152 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-57353142-bc17-4449-816b-ab41a376035d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.174562 Jun 20 18:48:51.377753 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 130/275] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:51 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:51.667637 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1a9c355e-0c63-45a9-b63f-c525fbee3d24 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "POST /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331929 Jun 20 18:48:51.668674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 146/276] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jun 20 18:48:51 2022] POST /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:48:52.395560 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-cad66d3e-42fd-4947-9577-9ed438ee782e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:52.396806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-cad66d3e-42fd-4947-9577-9ed438ee782e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:52.403970 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cad66d3e-42fd-4947-9577-9ed438ee782e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:52.404720 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cad66d3e-42fd-4947-9577-9ed438ee782e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:52.405724 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cad66d3e-42fd-4947-9577-9ed438ee782e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:52.406214 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cad66d3e-42fd-4947-9577-9ed438ee782e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:52.545704 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-cad66d3e-42fd-4947-9577-9ed438ee782e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:52.554520 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-cad66d3e-42fd-4947-9577-9ed438ee782e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.163768 Jun 20 18:48:52.555351 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 131/277] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:52 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:53.323222 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-404ac91a-c941-4948-aa7c-037ca8204003 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Action: 'create', calling method: .version_select at 0x7f7e44aac940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-519464206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDG4MfRS3uWpr+vNWaauby95t4gFJBfVRIp3XCirXr3t2jfUF2tPkwiOwDh1jEPApHFAjgJa9ROCIKKileW2Y9sEZJV/b+aeAsB7NjY9FNedxHyoiva1VJopmr1njt+Eg=="}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:48:53.338150 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-404ac91a-c941-4948-aa7c-037ca8204003 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Getting quotas for project 4b52def37b964824993a0edb3abc3413. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:48:53.342081 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-404ac91a-c941-4948-aa7c-037ca8204003 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Getting quotas for user b98488d018b04b34a6758f8b55925316 and project 4b52def37b964824993a0edb3abc3413. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:48:53.365450 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-404ac91a-c941-4948-aa7c-037ca8204003 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046974 Jun 20 18:48:53.366051 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 147/278] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jun 20 18:48:53 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:48:53.413602 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-677145590", "imageRef": "2d4c0f33-6a4e-4922-ae1f-291beab8a224", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-519464206", "networks": [{"uuid": "57a7ca4f-d5a4-43d4-8f26-968c9c0b83d7"}]}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:48:53.464540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.network.neutron [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] validate_networks() for [('57a7ca4f-d5a4-43d4-8f26-968c9c0b83d7', None, None, None, None, None)] {{(pid=124189) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:48:53.572883 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-17c11883-cc3f-42e0-b518-b42acb21b142 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:53.573609 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-17c11883-cc3f-42e0-b518-b42acb21b142 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:53.580398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-17c11883-cc3f-42e0-b518-b42acb21b142 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:53.580847 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-17c11883-cc3f-42e0-b518-b42acb21b142 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:53.581611 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-17c11883-cc3f-42e0-b518-b42acb21b142 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:53.582048 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-17c11883-cc3f-42e0-b518-b42acb21b142 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:53.839620 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Flavor limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:48:53.840044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Image limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:48:53.840515 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Flavor pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:48:53.841139 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Image pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:48:53.841748 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:48:53.852863 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-17c11883-cc3f-42e0-b518-b42acb21b142 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:53.858417 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:53.861411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-17c11883-cc3f-42e0-b518-b42acb21b142 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.292833 Jun 20 18:48:53.861971 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 148/279] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:53 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:48:53.865497 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:53.866453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:53.866994 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:53.883847 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Getting quotas for project 4b52def37b964824993a0edb3abc3413. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:48:53.887767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Getting quotas for user b98488d018b04b34a6758f8b55925316 and project 4b52def37b964824993a0edb3abc3413. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:48:53.898718 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Going to run 1 instances... {{(pid=124189) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:48:53.900928 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d4c0f33-6a4e-4922-ae1f-291beab8a224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124189) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:48:53.945633 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-cb1ebd95-b591-4248-a1f4-5ad7ffd7c4c3 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536100 Jun 20 18:48:53.946310 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 132/280] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:48:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:48:53.956239 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6d566388-8c92-4c92-b2f4-66c92e9f1a93 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:53.956877 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6d566388-8c92-4c92-b2f4-66c92e9f1a93 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:54.009538 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6d566388-8c92-4c92-b2f4-66c92e9f1a93 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:54.016694 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6d566388-8c92-4c92-b2f4-66c92e9f1a93 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1257 microversion: 2.1 time: 0.064357 Jun 20 18:48:54.017249 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 149/281] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:53 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1257 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:54.877483 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e60f602d-8eff-47c2-adc2-c04a782e66b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:54.878130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e60f602d-8eff-47c2-adc2-c04a782e66b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:54.885338 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e60f602d-8eff-47c2-adc2-c04a782e66b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:54.885786 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e60f602d-8eff-47c2-adc2-c04a782e66b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:54.886553 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e60f602d-8eff-47c2-adc2-c04a782e66b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:54.887199 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e60f602d-8eff-47c2-adc2-c04a782e66b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:55.036781 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a1e166d8-b79a-4bbf-8120-d01ac553fc01 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:55.037381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a1e166d8-b79a-4bbf-8120-d01ac553fc01 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:55.045352 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a1e166d8-b79a-4bbf-8120-d01ac553fc01 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:55.045790 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a1e166d8-b79a-4bbf-8120-d01ac553fc01 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:55.046568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a1e166d8-b79a-4bbf-8120-d01ac553fc01 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:55.047022 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a1e166d8-b79a-4bbf-8120-d01ac553fc01 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:55.049663 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:55.104287 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e60f602d-8eff-47c2-adc2-c04a782e66b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:55.112769 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e60f602d-8eff-47c2-adc2-c04a782e66b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.239111 Jun 20 18:48:55.114020 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 133/282] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:54 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:55.137360 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a1e166d8-b79a-4bbf-8120-d01ac553fc01 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:55.145414 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a1e166d8-b79a-4bbf-8120-d01ac553fc01 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1327 microversion: 2.1 time: 0.113341 Jun 20 18:48:55.146057 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 150/283] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:55 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:56.130746 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-40a05d2d-8958-45d0-a11a-4138de0c3f6e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:56.131444 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-40a05d2d-8958-45d0-a11a-4138de0c3f6e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:56.138352 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-40a05d2d-8958-45d0-a11a-4138de0c3f6e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:56.138805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-40a05d2d-8958-45d0-a11a-4138de0c3f6e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:56.139648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-40a05d2d-8958-45d0-a11a-4138de0c3f6e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:56.140086 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-40a05d2d-8958-45d0-a11a-4138de0c3f6e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:56.161742 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2da25935-6022-415d-8199-b33c06c2f1bf tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:56.162373 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2da25935-6022-415d-8199-b33c06c2f1bf tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:56.169690 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2da25935-6022-415d-8199-b33c06c2f1bf tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:56.170953 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2da25935-6022-415d-8199-b33c06c2f1bf tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:56.171828 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2da25935-6022-415d-8199-b33c06c2f1bf tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:56.172307 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2da25935-6022-415d-8199-b33c06c2f1bf tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:56.278521 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-40a05d2d-8958-45d0-a11a-4138de0c3f6e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:56.287087 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-40a05d2d-8958-45d0-a11a-4138de0c3f6e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.160879 Jun 20 18:48:56.299442 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 134/284] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:56 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:56.312838 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2da25935-6022-415d-8199-b33c06c2f1bf tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:56.320259 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2da25935-6022-415d-8199-b33c06c2f1bf tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.162544 Jun 20 18:48:56.320809 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 151/285] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:56 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:57.306746 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-bd70a1ab-1563-4a12-b226-1210cea96083 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:57.307306 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-bd70a1ab-1563-4a12-b226-1210cea96083 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:57.314319 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bd70a1ab-1563-4a12-b226-1210cea96083 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:57.315004 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bd70a1ab-1563-4a12-b226-1210cea96083 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:57.315768 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bd70a1ab-1563-4a12-b226-1210cea96083 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:57.316198 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bd70a1ab-1563-4a12-b226-1210cea96083 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:57.338365 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8b42228a-28f9-448e-b61a-871e08fbc1df tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:57.339050 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8b42228a-28f9-448e-b61a-871e08fbc1df tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:57.345506 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8b42228a-28f9-448e-b61a-871e08fbc1df tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:57.345951 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8b42228a-28f9-448e-b61a-871e08fbc1df tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:57.346713 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8b42228a-28f9-448e-b61a-871e08fbc1df tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:57.347191 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8b42228a-28f9-448e-b61a-871e08fbc1df tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:57.462389 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-bd70a1ab-1563-4a12-b226-1210cea96083 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:57.470357 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-bd70a1ab-1563-4a12-b226-1210cea96083 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.168180 Jun 20 18:48:57.470942 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 135/286] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:57 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:57.484529 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8b42228a-28f9-448e-b61a-871e08fbc1df tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:57.492039 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8b42228a-28f9-448e-b61a-871e08fbc1df tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.157466 Jun 20 18:48:57.492825 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 152/287] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:57 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:58.487207 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-60a8abbf-286b-425f-84d5-47dfbc1d43c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:58.487825 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-60a8abbf-286b-425f-84d5-47dfbc1d43c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:58.494795 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-60a8abbf-286b-425f-84d5-47dfbc1d43c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:58.495265 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-60a8abbf-286b-425f-84d5-47dfbc1d43c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:58.496016 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-60a8abbf-286b-425f-84d5-47dfbc1d43c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:58.496444 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-60a8abbf-286b-425f-84d5-47dfbc1d43c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:58.509343 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f5497a2d-a39c-4898-b406-0c759a3ac130 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:58.510076 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f5497a2d-a39c-4898-b406-0c759a3ac130 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:58.516972 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f5497a2d-a39c-4898-b406-0c759a3ac130 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:58.517416 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f5497a2d-a39c-4898-b406-0c759a3ac130 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:58.518172 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f5497a2d-a39c-4898-b406-0c759a3ac130 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:58.518600 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f5497a2d-a39c-4898-b406-0c759a3ac130 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:58.646514 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-60a8abbf-286b-425f-84d5-47dfbc1d43c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:58.654983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-60a8abbf-286b-425f-84d5-47dfbc1d43c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.171501 Jun 20 18:48:58.658047 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f5497a2d-a39c-4898-b406-0c759a3ac130 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:58.661566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 136/288] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:58 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:58.666085 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f5497a2d-a39c-4898-b406-0c759a3ac130 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.160509 Jun 20 18:48:58.666670 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 153/289] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:58 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:48:59.673240 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-24645b6b-224a-4341-8719-73ddbe869328 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:59.673865 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-24645b6b-224a-4341-8719-73ddbe869328 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:59.681299 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-24645b6b-224a-4341-8719-73ddbe869328 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:59.681748 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-24645b6b-224a-4341-8719-73ddbe869328 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:59.682524 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-24645b6b-224a-4341-8719-73ddbe869328 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:59.682985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-24645b6b-224a-4341-8719-73ddbe869328 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:59.683774 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-744b52fc-b326-462e-8ba5-b8d8c6f17098 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:48:59.684517 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-744b52fc-b326-462e-8ba5-b8d8c6f17098 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:48:59.691368 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-744b52fc-b326-462e-8ba5-b8d8c6f17098 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:59.691814 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-744b52fc-b326-462e-8ba5-b8d8c6f17098 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:59.692563 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-744b52fc-b326-462e-8ba5-b8d8c6f17098 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:48:59.692992 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-744b52fc-b326-462e-8ba5-b8d8c6f17098 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:48:59.845576 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-744b52fc-b326-462e-8ba5-b8d8c6f17098 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:59.847202 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-24645b6b-224a-4341-8719-73ddbe869328 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:48:59.853719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-744b52fc-b326-462e-8ba5-b8d8c6f17098 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.173662 Jun 20 18:48:59.854599 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 154/290] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:59 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:48:59.859951 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-435731718", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-997547484", "security_groups": [{"name": "tempest-secgroup-smoke-444768010"}], "networks": [{"uuid": "6034ecb2-defa-42ef-922e-c9c98bd98679"}], "block_device_mapping_v2": [{"uuid": "52eebcf2-244a-42b3-8191-f23c0215a0ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:48:59.865038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-24645b6b-224a-4341-8719-73ddbe869328 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.195574 Jun 20 18:48:59.865621 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 137/291] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:48:59 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:48:59.975025 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.network.neutron [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] validate_networks() for [('6034ecb2-defa-42ef-922e-c9c98bd98679', None, None, None, None, None)] {{(pid=124190) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:49:00.352832 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Flavor limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:49:00.353242 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Image limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:49:00.353698 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Flavor pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:49:00.354091 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Image pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:49:00.354494 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:49:00.363178 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:00.363615 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:00.364396 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:00.364825 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:00.381282 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Getting quotas for project afb8f33898e2408eaaac28b7f1802314. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:49:00.385385 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Getting quotas for user a5d3b9702e434e038466969abfae2338 and project afb8f33898e2408eaaac28b7f1802314. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:49:00.444992 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Going to run 1 instances... {{(pid=124190) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:49:00.447160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='52eebcf2-244a-42b3-8191-f23c0215a0ea',volume_size=None,volume_type=None)] {{(pid=124190) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:49:00.578728 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-991f47e9-fa4f-434f-849f-fae25ea140a8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.722710 Jun 20 18:49:00.579568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 155/292] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:48:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:49:00.590399 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-341a81fe-6482-4ed6-ad9e-dcdfa021df5e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:00.591295 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-341a81fe-6482-4ed6-ad9e-dcdfa021df5e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:00.646651 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-341a81fe-6482-4ed6-ad9e-dcdfa021df5e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:00.654386 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-341a81fe-6482-4ed6-ad9e-dcdfa021df5e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1087 microversion: 2.1 time: 0.067796 Jun 20 18:49:00.655302 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 138/293] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:00 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:00.873069 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-861d99a2-7fa7-4cb7-a21b-d133ab8add04 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:00.873711 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-861d99a2-7fa7-4cb7-a21b-d133ab8add04 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:00.881507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-03e96bf7-1f36-4d40-a9f3-358006b14f7c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:00.882113 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-03e96bf7-1f36-4d40-a9f3-358006b14f7c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:00.892695 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-03e96bf7-1f36-4d40-a9f3-358006b14f7c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:00.893143 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-03e96bf7-1f36-4d40-a9f3-358006b14f7c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:00.894339 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-03e96bf7-1f36-4d40-a9f3-358006b14f7c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:00.894809 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-03e96bf7-1f36-4d40-a9f3-358006b14f7c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:00.895088 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-861d99a2-7fa7-4cb7-a21b-d133ab8add04 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:00.895620 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-861d99a2-7fa7-4cb7-a21b-d133ab8add04 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:00.896460 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-861d99a2-7fa7-4cb7-a21b-d133ab8add04 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:00.896922 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-861d99a2-7fa7-4cb7-a21b-d133ab8add04 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:01.043193 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-03e96bf7-1f36-4d40-a9f3-358006b14f7c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:01.046408 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-03e96bf7-1f36-4d40-a9f3-358006b14f7c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.168642 Jun 20 18:49:01.049198 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 139/294] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:00 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:01.104111 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-861d99a2-7fa7-4cb7-a21b-d133ab8add04 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:01.111614 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-861d99a2-7fa7-4cb7-a21b-d133ab8add04 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.243788 Jun 20 18:49:01.112165 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 156/295] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:00 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:01.672910 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a0bb6309-e5cd-428a-a91f-3b7419967928 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:01.673467 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a0bb6309-e5cd-428a-a91f-3b7419967928 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:01.679647 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a0bb6309-e5cd-428a-a91f-3b7419967928 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:01.680136 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a0bb6309-e5cd-428a-a91f-3b7419967928 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:01.680894 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a0bb6309-e5cd-428a-a91f-3b7419967928 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:01.681334 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a0bb6309-e5cd-428a-a91f-3b7419967928 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:01.745102 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a0bb6309-e5cd-428a-a91f-3b7419967928 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:01.753106 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a0bb6309-e5cd-428a-a91f-3b7419967928 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1137 microversion: 2.1 time: 0.084749 Jun 20 18:49:01.753666 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 140/296] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:01 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:02.063710 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-92433c9a-81e5-4e6c-86ad-df9198bcf3e0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:02.065054 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-92433c9a-81e5-4e6c-86ad-df9198bcf3e0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:02.071908 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-92433c9a-81e5-4e6c-86ad-df9198bcf3e0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:02.072373 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-92433c9a-81e5-4e6c-86ad-df9198bcf3e0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:02.073172 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-92433c9a-81e5-4e6c-86ad-df9198bcf3e0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:02.073654 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-92433c9a-81e5-4e6c-86ad-df9198bcf3e0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:02.128296 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-04edb987-b934-4e6a-bc72-d99b27a23e5f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:02.129029 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-04edb987-b934-4e6a-bc72-d99b27a23e5f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:02.136373 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-04edb987-b934-4e6a-bc72-d99b27a23e5f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:02.136827 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-04edb987-b934-4e6a-bc72-d99b27a23e5f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:02.137601 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-04edb987-b934-4e6a-bc72-d99b27a23e5f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:02.139380 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-04edb987-b934-4e6a-bc72-d99b27a23e5f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:02.227028 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-92433c9a-81e5-4e6c-86ad-df9198bcf3e0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:02.236917 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-92433c9a-81e5-4e6c-86ad-df9198bcf3e0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.177532 Jun 20 18:49:02.237940 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 157/297] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:02 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:02.286901 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-04edb987-b934-4e6a-bc72-d99b27a23e5f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:02.289388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:02.296031 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-04edb987-b934-4e6a-bc72-d99b27a23e5f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.171537 Jun 20 18:49:02.304872 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 141/298] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:02 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:02.769892 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b688ba7b-551a-4c09-a201-e8c46e71097a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:02.770497 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b688ba7b-551a-4c09-a201-e8c46e71097a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:02.776503 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b688ba7b-551a-4c09-a201-e8c46e71097a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:02.776946 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b688ba7b-551a-4c09-a201-e8c46e71097a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:02.777695 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b688ba7b-551a-4c09-a201-e8c46e71097a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:02.778129 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b688ba7b-551a-4c09-a201-e8c46e71097a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:02.844439 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b688ba7b-551a-4c09-a201-e8c46e71097a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:02.851818 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b688ba7b-551a-4c09-a201-e8c46e71097a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1137 microversion: 2.1 time: 0.085919 Jun 20 18:49:02.852447 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 158/299] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:02 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:03.254290 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-cffdc8cb-c8d9-4dfd-883b-f52e0fba2af3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:03.254897 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-cffdc8cb-c8d9-4dfd-883b-f52e0fba2af3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:03.261661 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cffdc8cb-c8d9-4dfd-883b-f52e0fba2af3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:03.262103 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cffdc8cb-c8d9-4dfd-883b-f52e0fba2af3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:03.262845 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cffdc8cb-c8d9-4dfd-883b-f52e0fba2af3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:03.263295 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cffdc8cb-c8d9-4dfd-883b-f52e0fba2af3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:03.312608 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9e62ea06-a350-489b-965c-98d567160016 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:03.313208 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9e62ea06-a350-489b-965c-98d567160016 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:03.319907 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9e62ea06-a350-489b-965c-98d567160016 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:03.320433 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9e62ea06-a350-489b-965c-98d567160016 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:03.321261 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9e62ea06-a350-489b-965c-98d567160016 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:03.321700 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9e62ea06-a350-489b-965c-98d567160016 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:03.433031 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-cffdc8cb-c8d9-4dfd-883b-f52e0fba2af3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:03.443693 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-cffdc8cb-c8d9-4dfd-883b-f52e0fba2af3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.193069 Jun 20 18:49:03.444510 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 142/300] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:03 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:03.476333 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9e62ea06-a350-489b-965c-98d567160016 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:03.485492 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9e62ea06-a350-489b-965c-98d567160016 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.176919 Jun 20 18:49:03.495283 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 159/301] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:03 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:03.868169 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f067b544-291b-411b-bbf7-bd19dd8ea6e8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:03.868773 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f067b544-291b-411b-bbf7-bd19dd8ea6e8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:03.874405 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:03.876510 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f067b544-291b-411b-bbf7-bd19dd8ea6e8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:03.876955 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f067b544-291b-411b-bbf7-bd19dd8ea6e8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:03.877715 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f067b544-291b-411b-bbf7-bd19dd8ea6e8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:03.878151 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f067b544-291b-411b-bbf7-bd19dd8ea6e8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:03.941713 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f067b544-291b-411b-bbf7-bd19dd8ea6e8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:03.949613 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f067b544-291b-411b-bbf7-bd19dd8ea6e8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1137 microversion: 2.1 time: 0.085322 Jun 20 18:49:03.950177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 143/302] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:03 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:04.462131 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1f1e0dee-81a9-4bf4-862a-e1e536713706 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:04.462741 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1f1e0dee-81a9-4bf4-862a-e1e536713706 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:04.469329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1f1e0dee-81a9-4bf4-862a-e1e536713706 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:04.469779 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1f1e0dee-81a9-4bf4-862a-e1e536713706 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:04.470546 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1f1e0dee-81a9-4bf4-862a-e1e536713706 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:04.471002 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1f1e0dee-81a9-4bf4-862a-e1e536713706 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:04.505772 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f1124f78-840e-4790-a502-7729ad9a642d tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:04.506475 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f1124f78-840e-4790-a502-7729ad9a642d tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:04.513278 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f1124f78-840e-4790-a502-7729ad9a642d tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:04.514451 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f1124f78-840e-4790-a502-7729ad9a642d tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:04.515303 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f1124f78-840e-4790-a502-7729ad9a642d tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:04.515807 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f1124f78-840e-4790-a502-7729ad9a642d tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:04.609299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-1f1e0dee-81a9-4bf4-862a-e1e536713706 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:04.616923 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1f1e0dee-81a9-4bf4-862a-e1e536713706 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.160017 Jun 20 18:49:04.617495 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 160/303] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:04 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:04.657998 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f1124f78-840e-4790-a502-7729ad9a642d tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:04.665995 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f1124f78-840e-4790-a502-7729ad9a642d tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.164822 Jun 20 18:49:04.666551 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 144/304] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:04 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:04.965543 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2a31479b-84d7-4b30-b2c9-12137b74db99 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:04.966139 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2a31479b-84d7-4b30-b2c9-12137b74db99 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:04.972190 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2a31479b-84d7-4b30-b2c9-12137b74db99 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:04.972579 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2a31479b-84d7-4b30-b2c9-12137b74db99 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:04.973326 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2a31479b-84d7-4b30-b2c9-12137b74db99 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:04.973766 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2a31479b-84d7-4b30-b2c9-12137b74db99 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:05.038256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2a31479b-84d7-4b30-b2c9-12137b74db99 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:05.045719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2a31479b-84d7-4b30-b2c9-12137b74db99 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1137 microversion: 2.1 time: 0.083984 Jun 20 18:49:05.055149 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 161/305] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:04 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1137 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:05.633711 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7a02346e-1825-4c50-ae25-38d0aa4b9d8f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:05.634321 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7a02346e-1825-4c50-ae25-38d0aa4b9d8f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:05.641005 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7a02346e-1825-4c50-ae25-38d0aa4b9d8f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:05.641451 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7a02346e-1825-4c50-ae25-38d0aa4b9d8f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:05.642227 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7a02346e-1825-4c50-ae25-38d0aa4b9d8f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:05.642636 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7a02346e-1825-4c50-ae25-38d0aa4b9d8f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:05.682422 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8593003d-ab54-43ab-9c9e-b411d4d56375 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:05.690880 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8593003d-ab54-43ab-9c9e-b411d4d56375 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:05.701789 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8593003d-ab54-43ab-9c9e-b411d4d56375 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:05.702234 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8593003d-ab54-43ab-9c9e-b411d4d56375 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:05.703239 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8593003d-ab54-43ab-9c9e-b411d4d56375 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:05.703678 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8593003d-ab54-43ab-9c9e-b411d4d56375 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:05.784248 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7a02346e-1825-4c50-ae25-38d0aa4b9d8f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:05.792137 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7a02346e-1825-4c50-ae25-38d0aa4b9d8f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.162288 Jun 20 18:49:05.793005 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 145/306] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:05 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:05.861410 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8593003d-ab54-43ab-9c9e-b411d4d56375 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:05.869024 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8593003d-ab54-43ab-9c9e-b411d4d56375 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.190447 Jun 20 18:49:05.869583 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 162/307] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:05 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:06.061903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d6c6f3fa-437b-48c7-a7b2-91026361c848 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:06.062510 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d6c6f3fa-437b-48c7-a7b2-91026361c848 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:06.069255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6c6f3fa-437b-48c7-a7b2-91026361c848 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:06.069696 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6c6f3fa-437b-48c7-a7b2-91026361c848 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:06.070453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6c6f3fa-437b-48c7-a7b2-91026361c848 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:06.070882 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6c6f3fa-437b-48c7-a7b2-91026361c848 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:06.134794 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d6c6f3fa-437b-48c7-a7b2-91026361c848 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:06.143049 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d6c6f3fa-437b-48c7-a7b2-91026361c848 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1137 microversion: 2.1 time: 0.085318 Jun 20 18:49:06.143626 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 146/308] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:06 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:06.809705 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-cc03ae11-943a-4a87-ba9c-08144ddcf069 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:06.810953 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-cc03ae11-943a-4a87-ba9c-08144ddcf069 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:06.817528 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cc03ae11-943a-4a87-ba9c-08144ddcf069 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:06.817977 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cc03ae11-943a-4a87-ba9c-08144ddcf069 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:06.818745 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cc03ae11-943a-4a87-ba9c-08144ddcf069 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:06.819211 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cc03ae11-943a-4a87-ba9c-08144ddcf069 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:06.885648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7e780b42-3095-4337-8e3a-42a2d21446fe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:06.886247 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7e780b42-3095-4337-8e3a-42a2d21446fe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:06.892667 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7e780b42-3095-4337-8e3a-42a2d21446fe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:06.893114 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7e780b42-3095-4337-8e3a-42a2d21446fe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:06.893867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7e780b42-3095-4337-8e3a-42a2d21446fe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:06.894294 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7e780b42-3095-4337-8e3a-42a2d21446fe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:06.961259 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cc03ae11-943a-4a87-ba9c-08144ddcf069 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:06.971192 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-cc03ae11-943a-4a87-ba9c-08144ddcf069 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.165361 Jun 20 18:49:06.971769 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 163/309] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:06 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:07.034745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7e780b42-3095-4337-8e3a-42a2d21446fe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:07.042324 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7e780b42-3095-4337-8e3a-42a2d21446fe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.160554 Jun 20 18:49:07.042874 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 147/310] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:06 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:07.160332 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d0794ad5-3787-475d-807e-2c70475e6b0f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:07.160845 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d0794ad5-3787-475d-807e-2c70475e6b0f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:07.167106 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d0794ad5-3787-475d-807e-2c70475e6b0f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:07.167547 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d0794ad5-3787-475d-807e-2c70475e6b0f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:07.168293 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d0794ad5-3787-475d-807e-2c70475e6b0f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:07.168719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d0794ad5-3787-475d-807e-2c70475e6b0f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:07.228281 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d0794ad5-3787-475d-807e-2c70475e6b0f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:07.236219 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d0794ad5-3787-475d-807e-2c70475e6b0f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1137 microversion: 2.1 time: 0.079898 Jun 20 18:49:07.240961 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 164/311] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:07 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1137 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:07.988738 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3f1801dc-8fe8-4ef0-ab5c-f71b4bd3669b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:07.989533 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-3f1801dc-8fe8-4ef0-ab5c-f71b4bd3669b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:07.996373 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3f1801dc-8fe8-4ef0-ab5c-f71b4bd3669b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:07.997084 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3f1801dc-8fe8-4ef0-ab5c-f71b4bd3669b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:07.997897 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3f1801dc-8fe8-4ef0-ab5c-f71b4bd3669b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:07.998336 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3f1801dc-8fe8-4ef0-ab5c-f71b4bd3669b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:08.059584 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5a152f76-4153-4294-aa92-1c57e025cb30 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:08.060214 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5a152f76-4153-4294-aa92-1c57e025cb30 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:08.067103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5a152f76-4153-4294-aa92-1c57e025cb30 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:08.067799 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5a152f76-4153-4294-aa92-1c57e025cb30 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:08.068741 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5a152f76-4153-4294-aa92-1c57e025cb30 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:08.069333 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5a152f76-4153-4294-aa92-1c57e025cb30 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:08.132238 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-3f1801dc-8fe8-4ef0-ab5c-f71b4bd3669b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:08.139776 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-3f1801dc-8fe8-4ef0-ab5c-f71b4bd3669b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.154973 Jun 20 18:49:08.140677 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 148/312] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:07 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:08.210522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5a152f76-4153-4294-aa92-1c57e025cb30 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:08.218680 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5a152f76-4153-4294-aa92-1c57e025cb30 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.162958 Jun 20 18:49:08.222959 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 165/313] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:08 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:08.253831 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-148f61e5-697b-476a-8ec1-c96bea2a87e0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:08.254353 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-148f61e5-697b-476a-8ec1-c96bea2a87e0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:08.260689 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-148f61e5-697b-476a-8ec1-c96bea2a87e0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:08.261132 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-148f61e5-697b-476a-8ec1-c96bea2a87e0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:08.261899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-148f61e5-697b-476a-8ec1-c96bea2a87e0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:08.262330 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-148f61e5-697b-476a-8ec1-c96bea2a87e0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:08.328319 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-148f61e5-697b-476a-8ec1-c96bea2a87e0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:08.335736 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-148f61e5-697b-476a-8ec1-c96bea2a87e0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1137 microversion: 2.1 time: 0.085855 Jun 20 18:49:08.336287 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 149/314] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:08 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:09.156453 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0756cd30-e1cb-4093-b692-5131c24f5b99 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:09.157066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0756cd30-e1cb-4093-b692-5131c24f5b99 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:09.163813 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0756cd30-e1cb-4093-b692-5131c24f5b99 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:09.164261 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0756cd30-e1cb-4093-b692-5131c24f5b99 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:09.165017 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0756cd30-e1cb-4093-b692-5131c24f5b99 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:09.165453 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0756cd30-e1cb-4093-b692-5131c24f5b99 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:09.234486 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-812fa925-5eb5-4198-83ec-74095eca85a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:09.235162 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-812fa925-5eb5-4198-83ec-74095eca85a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:09.242105 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-812fa925-5eb5-4198-83ec-74095eca85a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:09.242105 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-812fa925-5eb5-4198-83ec-74095eca85a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:09.242805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-812fa925-5eb5-4198-83ec-74095eca85a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:09.243271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-812fa925-5eb5-4198-83ec-74095eca85a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:09.293727 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0756cd30-e1cb-4093-b692-5131c24f5b99 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:09.301217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0756cd30-e1cb-4093-b692-5131c24f5b99 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.148666 Jun 20 18:49:09.301781 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 166/315] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:09 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:09.353208 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6eb6500d-e444-42b9-9fd6-3243293b9067 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:09.353815 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6eb6500d-e444-42b9-9fd6-3243293b9067 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:09.360294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6eb6500d-e444-42b9-9fd6-3243293b9067 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:09.360744 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6eb6500d-e444-42b9-9fd6-3243293b9067 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:09.361498 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6eb6500d-e444-42b9-9fd6-3243293b9067 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:09.361933 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6eb6500d-e444-42b9-9fd6-3243293b9067 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:09.372221 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-812fa925-5eb5-4198-83ec-74095eca85a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:09.376713 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=100 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:09.380167 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-812fa925-5eb5-4198-83ec-74095eca85a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.149498 Jun 20 18:49:09.380731 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 150/316] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:09 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:09.423428 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6eb6500d-e444-42b9-9fd6-3243293b9067 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:09.430771 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6eb6500d-e444-42b9-9fd6-3243293b9067 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1137 microversion: 2.1 time: 0.082204 Jun 20 18:49:09.431358 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 167/317] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:09 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:10.317505 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5f44118c-6c40-4068-b60b-5a0fb6dd4097 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:10.318111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5f44118c-6c40-4068-b60b-5a0fb6dd4097 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:10.324523 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5f44118c-6c40-4068-b60b-5a0fb6dd4097 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:10.324959 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5f44118c-6c40-4068-b60b-5a0fb6dd4097 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:10.325711 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5f44118c-6c40-4068-b60b-5a0fb6dd4097 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:10.326132 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5f44118c-6c40-4068-b60b-5a0fb6dd4097 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:10.396894 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7d858cc2-59b5-4711-a515-cd9448670480 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:10.397488 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7d858cc2-59b5-4711-a515-cd9448670480 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:10.399828 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:10.400476 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=12 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:10.401143 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:10.408244 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7d858cc2-59b5-4711-a515-cd9448670480 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:10.408786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7d858cc2-59b5-4711-a515-cd9448670480 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:10.409558 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7d858cc2-59b5-4711-a515-cd9448670480 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:10.409988 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7d858cc2-59b5-4711-a515-cd9448670480 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:10.453917 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5f44118c-6c40-4068-b60b-5a0fb6dd4097 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:10.462445 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5f44118c-6c40-4068-b60b-5a0fb6dd4097 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.148744 Jun 20 18:49:10.463032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 151/318] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:10 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:10.468299 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-375db06c-f87d-4ef7-9943-0c005de0ac18 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:10.468948 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-375db06c-f87d-4ef7-9943-0c005de0ac18 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:10.480750 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-375db06c-f87d-4ef7-9943-0c005de0ac18 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:10.481260 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-375db06c-f87d-4ef7-9943-0c005de0ac18 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:10.485134 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-375db06c-f87d-4ef7-9943-0c005de0ac18 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:10.485658 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-375db06c-f87d-4ef7-9943-0c005de0ac18 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:10.568310 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7d858cc2-59b5-4711-a515-cd9448670480 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:10.578783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-375db06c-f87d-4ef7-9943-0c005de0ac18 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:10.587424 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-375db06c-f87d-4ef7-9943-0c005de0ac18 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1137 microversion: 2.1 time: 0.123239 Jun 20 18:49:10.590779 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 152/319] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:10 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1137 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:10.602619 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7d858cc2-59b5-4711-a515-cd9448670480 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.208869 Jun 20 18:49:10.603301 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 168/320] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:10 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:11.487957 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-10039af4-5e64-4173-b1d1-67daf7e5cf0f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:11.488567 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-10039af4-5e64-4173-b1d1-67daf7e5cf0f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:11.490414 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=8 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:11.491598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:11.496698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-10039af4-5e64-4173-b1d1-67daf7e5cf0f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:11.497145 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-10039af4-5e64-4173-b1d1-67daf7e5cf0f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:11.497906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-10039af4-5e64-4173-b1d1-67daf7e5cf0f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:11.498342 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-10039af4-5e64-4173-b1d1-67daf7e5cf0f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:11.606212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5f6e2f0f-a038-4bee-91ff-57881db2c0d5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:11.608089 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5f6e2f0f-a038-4bee-91ff-57881db2c0d5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:11.615492 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5f6e2f0f-a038-4bee-91ff-57881db2c0d5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:11.616183 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5f6e2f0f-a038-4bee-91ff-57881db2c0d5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:11.616946 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5f6e2f0f-a038-4bee-91ff-57881db2c0d5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:11.617572 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5f6e2f0f-a038-4bee-91ff-57881db2c0d5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:11.679604 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5f6e2f0f-a038-4bee-91ff-57881db2c0d5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:11.687043 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5f6e2f0f-a038-4bee-91ff-57881db2c0d5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1129 microversion: 2.1 time: 0.085566 Jun 20 18:49:11.687685 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 169/321] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:11 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1129 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:11.692876 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7fa8ed7b-909c-464e-90cd-ddc773a22cba tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:11.692876 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7fa8ed7b-909c-464e-90cd-ddc773a22cba tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:11.699177 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7fa8ed7b-909c-464e-90cd-ddc773a22cba tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:11.699699 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7fa8ed7b-909c-464e-90cd-ddc773a22cba tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:11.700466 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7fa8ed7b-909c-464e-90cd-ddc773a22cba tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:11.700934 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7fa8ed7b-909c-464e-90cd-ddc773a22cba tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:11.755911 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-10039af4-5e64-4173-b1d1-67daf7e5cf0f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:11.763437 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-10039af4-5e64-4173-b1d1-67daf7e5cf0f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.279321 Jun 20 18:49:11.769941 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 153/322] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:11 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:11.830958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7fa8ed7b-909c-464e-90cd-ddc773a22cba tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:11.838688 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7fa8ed7b-909c-464e-90cd-ddc773a22cba tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.150036 Jun 20 18:49:11.839296 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 170/323] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:11 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:12.509213 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-3a5c6b4a-9506-43fb-bad1-8ff3502548cd req-4c8dbbdc-8735-469d-ae31-c396ed1ce163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a42434-2efd-4f8e-b3fb-e77f0e99f072", "tag": "96708947-b2a6-41f9-8eb6-1a4bc89a1294"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:12.518541 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-3a5c6b4a-9506-43fb-bad1-8ff3502548cd req-4c8dbbdc-8735-469d-ae31-c396ed1ce163 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:12.519177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-3a5c6b4a-9506-43fb-bad1-8ff3502548cd req-4c8dbbdc-8735-469d-ae31-c396ed1ce163 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:12.530934 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-3a5c6b4a-9506-43fb-bad1-8ff3502548cd req-4c8dbbdc-8735-469d-ae31-c396ed1ce163 service nova] Creating event network-changed:96708947-b2a6-41f9-8eb6-1a4bc89a1294 for instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 on hv-cinder-83697 Jun 20 18:49:12.536005 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-3a5c6b4a-9506-43fb-bad1-8ff3502548cd req-4c8dbbdc-8735-469d-ae31-c396ed1ce163 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030597 Jun 20 18:49:12.536596 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 154/324] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:49:12.704415 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-bf8a3564-466c-4544-add2-ea0b0fa46763 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:12.705374 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-bf8a3564-466c-4544-add2-ea0b0fa46763 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:12.715775 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bf8a3564-466c-4544-add2-ea0b0fa46763 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:12.716222 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bf8a3564-466c-4544-add2-ea0b0fa46763 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:12.717500 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bf8a3564-466c-4544-add2-ea0b0fa46763 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:12.717929 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bf8a3564-466c-4544-add2-ea0b0fa46763 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:12.781491 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7b55b7d3-281e-4c7e-80c7-1b0b781cbf8c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:12.782140 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7b55b7d3-281e-4c7e-80c7-1b0b781cbf8c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:12.788726 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7b55b7d3-281e-4c7e-80c7-1b0b781cbf8c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:12.789175 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7b55b7d3-281e-4c7e-80c7-1b0b781cbf8c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:12.789939 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7b55b7d3-281e-4c7e-80c7-1b0b781cbf8c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:12.790553 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7b55b7d3-281e-4c7e-80c7-1b0b781cbf8c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:12.806153 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-bf8a3564-466c-4544-add2-ea0b0fa46763 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:12.815472 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-bf8a3564-466c-4544-add2-ea0b0fa46763 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1129 microversion: 2.1 time: 0.115125 Jun 20 18:49:12.816371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 171/325] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:12 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1129 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:12.855600 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1794bf2d-7d20-47d1-930c-5f30be922563 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:12.856581 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1794bf2d-7d20-47d1-930c-5f30be922563 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:12.862819 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1794bf2d-7d20-47d1-930c-5f30be922563 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:12.863316 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1794bf2d-7d20-47d1-930c-5f30be922563 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:12.864076 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1794bf2d-7d20-47d1-930c-5f30be922563 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:12.865191 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1794bf2d-7d20-47d1-930c-5f30be922563 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:13.010695 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-1794bf2d-7d20-47d1-930c-5f30be922563 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:13.021567 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1794bf2d-7d20-47d1-930c-5f30be922563 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.169707 Jun 20 18:49:13.022317 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 172/326] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:12 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:13.025427 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7b55b7d3-281e-4c7e-80c7-1b0b781cbf8c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:13.036775 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7b55b7d3-281e-4c7e-80c7-1b0b781cbf8c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.260075 Jun 20 18:49:13.037341 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 155/327] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:12 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:13.698141 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-3664ea05-e315-439f-a653-8dd2ad9da099 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:13.698623 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-3664ea05-e315-439f-a653-8dd2ad9da099 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:13.705181 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3664ea05-e315-439f-a653-8dd2ad9da099 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:13.705711 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3664ea05-e315-439f-a653-8dd2ad9da099 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:13.706387 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3664ea05-e315-439f-a653-8dd2ad9da099 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:13.706813 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3664ea05-e315-439f-a653-8dd2ad9da099 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:13.736202 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-3664ea05-e315-439f-a653-8dd2ad9da099 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/ips" status: 200 len: 146 microversion: 2.1 time: 0.041863 Jun 20 18:49:13.736765 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 173/328] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jun 20 18:49:13 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:49:13.832280 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5f877783-2ddc-4cc4-9478-ee3b1619cd6a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:13.832873 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5f877783-2ddc-4cc4-9478-ee3b1619cd6a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:13.839327 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5f877783-2ddc-4cc4-9478-ee3b1619cd6a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:13.839766 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5f877783-2ddc-4cc4-9478-ee3b1619cd6a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:13.840513 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5f877783-2ddc-4cc4-9478-ee3b1619cd6a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:13.840939 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5f877783-2ddc-4cc4-9478-ee3b1619cd6a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:13.904917 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5f877783-2ddc-4cc4-9478-ee3b1619cd6a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:13.912228 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5f877783-2ddc-4cc4-9478-ee3b1619cd6a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1185 microversion: 2.1 time: 0.083772 Jun 20 18:49:13.913050 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 156/329] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:13 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:14.037958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-dc6a71a3-ad23-453e-ba9f-6e0fe8916319 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:14.038557 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-dc6a71a3-ad23-453e-ba9f-6e0fe8916319 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:14.045103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dc6a71a3-ad23-453e-ba9f-6e0fe8916319 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:14.045546 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dc6a71a3-ad23-453e-ba9f-6e0fe8916319 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:14.046292 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dc6a71a3-ad23-453e-ba9f-6e0fe8916319 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:14.046717 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dc6a71a3-ad23-453e-ba9f-6e0fe8916319 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:14.055547 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8ecfec34-ba66-4d4b-9609-6b3907ea03eb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:14.056175 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8ecfec34-ba66-4d4b-9609-6b3907ea03eb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:14.062174 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8ecfec34-ba66-4d4b-9609-6b3907ea03eb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:14.062644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8ecfec34-ba66-4d4b-9609-6b3907ea03eb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:14.063433 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8ecfec34-ba66-4d4b-9609-6b3907ea03eb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:14.063864 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8ecfec34-ba66-4d4b-9609-6b3907ea03eb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:14.176585 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-dc6a71a3-ad23-453e-ba9f-6e0fe8916319 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:14.184060 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-dc6a71a3-ad23-453e-ba9f-6e0fe8916319 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.150237 Jun 20 18:49:14.184614 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 174/330] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:14 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:14.196990 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8ecfec34-ba66-4d4b-9609-6b3907ea03eb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:14.204263 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8ecfec34-ba66-4d4b-9609-6b3907ea03eb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.152444 Jun 20 18:49:14.204811 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 157/331] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:14 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:14.929381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d2fa535a-bdb0-4c78-b13f-981a8a3e6a64 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:14.929981 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d2fa535a-bdb0-4c78-b13f-981a8a3e6a64 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:14.936365 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d2fa535a-bdb0-4c78-b13f-981a8a3e6a64 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:14.936805 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d2fa535a-bdb0-4c78-b13f-981a8a3e6a64 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:14.937550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d2fa535a-bdb0-4c78-b13f-981a8a3e6a64 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:14.937979 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d2fa535a-bdb0-4c78-b13f-981a8a3e6a64 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:15.002220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d2fa535a-bdb0-4c78-b13f-981a8a3e6a64 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:15.009565 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d2fa535a-bdb0-4c78-b13f-981a8a3e6a64 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1185 microversion: 2.1 time: 0.084012 Jun 20 18:49:15.010110 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 175/332] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:14 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:15.200096 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f9647dfc-b9c5-4e96-a0f5-dd70c1b2626a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:15.200786 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f9647dfc-b9c5-4e96-a0f5-dd70c1b2626a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:15.207173 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f9647dfc-b9c5-4e96-a0f5-dd70c1b2626a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:15.207632 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f9647dfc-b9c5-4e96-a0f5-dd70c1b2626a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:15.208407 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f9647dfc-b9c5-4e96-a0f5-dd70c1b2626a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:15.208879 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f9647dfc-b9c5-4e96-a0f5-dd70c1b2626a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:15.221131 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d4a00499-40f8-4ce2-a13c-1bdc783f15f0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:15.221836 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d4a00499-40f8-4ce2-a13c-1bdc783f15f0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:15.227802 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d4a00499-40f8-4ce2-a13c-1bdc783f15f0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:15.228251 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d4a00499-40f8-4ce2-a13c-1bdc783f15f0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:15.229007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d4a00499-40f8-4ce2-a13c-1bdc783f15f0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:15.229439 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d4a00499-40f8-4ce2-a13c-1bdc783f15f0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:15.336569 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f9647dfc-b9c5-4e96-a0f5-dd70c1b2626a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:15.344170 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f9647dfc-b9c5-4e96-a0f5-dd70c1b2626a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.148015 Jun 20 18:49:15.344938 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 158/333] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:15 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:15.357914 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d4a00499-40f8-4ce2-a13c-1bdc783f15f0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:15.365358 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d4a00499-40f8-4ce2-a13c-1bdc783f15f0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.148269 Jun 20 18:49:15.365905 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 176/334] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:15 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:15.382308 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-cf44bf35-44a0-4a9c-80ec-9fd59905ec11 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:15.382802 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-cf44bf35-44a0-4a9c-80ec-9fd59905ec11 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:15.388790 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cf44bf35-44a0-4a9c-80ec-9fd59905ec11 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:15.389230 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cf44bf35-44a0-4a9c-80ec-9fd59905ec11 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:15.389983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cf44bf35-44a0-4a9c-80ec-9fd59905ec11 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:15.390414 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cf44bf35-44a0-4a9c-80ec-9fd59905ec11 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:15.394060 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:15.413794 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-cf44bf35-44a0-4a9c-80ec-9fd59905ec11 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a/ips" status: 200 len: 148 microversion: 2.1 time: 0.035331 Jun 20 18:49:15.414343 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 159/335] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jun 20 18:49:15 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a/ips => generated 148 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:49:16.026843 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c56ed23a-62ad-42dc-bc05-f63d6fcd2ed4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:16.027489 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c56ed23a-62ad-42dc-bc05-f63d6fcd2ed4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:16.034570 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c56ed23a-62ad-42dc-bc05-f63d6fcd2ed4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:16.035052 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c56ed23a-62ad-42dc-bc05-f63d6fcd2ed4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:16.035812 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c56ed23a-62ad-42dc-bc05-f63d6fcd2ed4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:16.036245 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c56ed23a-62ad-42dc-bc05-f63d6fcd2ed4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:16.096314 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c56ed23a-62ad-42dc-bc05-f63d6fcd2ed4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:16.103567 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c56ed23a-62ad-42dc-bc05-f63d6fcd2ed4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1185 microversion: 2.1 time: 0.080607 Jun 20 18:49:16.104122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 177/336] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:16 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:16.361157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-54a3dc89-d942-43fc-8616-9e5816bd7405 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:16.361685 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-54a3dc89-d942-43fc-8616-9e5816bd7405 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:16.367677 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-54a3dc89-d942-43fc-8616-9e5816bd7405 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:16.368113 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-54a3dc89-d942-43fc-8616-9e5816bd7405 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:16.368853 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-54a3dc89-d942-43fc-8616-9e5816bd7405 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:16.369279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-54a3dc89-d942-43fc-8616-9e5816bd7405 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:16.382754 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-57de9df8-8c83-4b9b-b18b-b8647bc09ff3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:16.383390 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-57de9df8-8c83-4b9b-b18b-b8647bc09ff3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:16.389935 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-57de9df8-8c83-4b9b-b18b-b8647bc09ff3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:16.390400 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-57de9df8-8c83-4b9b-b18b-b8647bc09ff3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:16.391186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-57de9df8-8c83-4b9b-b18b-b8647bc09ff3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:16.391625 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-57de9df8-8c83-4b9b-b18b-b8647bc09ff3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:16.500900 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-54a3dc89-d942-43fc-8616-9e5816bd7405 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:16.508414 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-54a3dc89-d942-43fc-8616-9e5816bd7405 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.151233 Jun 20 18:49:16.509058 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 160/337] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:16 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:16.520493 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-57de9df8-8c83-4b9b-b18b-b8647bc09ff3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:16.527954 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-57de9df8-8c83-4b9b-b18b-b8647bc09ff3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.149012 Jun 20 18:49:16.528511 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 178/338] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:16 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:17.119999 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f45ab7ff-41d8-49aa-a4a3-ccf387202d5e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:17.120603 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f45ab7ff-41d8-49aa-a4a3-ccf387202d5e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:17.127090 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f45ab7ff-41d8-49aa-a4a3-ccf387202d5e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:17.127554 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f45ab7ff-41d8-49aa-a4a3-ccf387202d5e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:17.128283 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f45ab7ff-41d8-49aa-a4a3-ccf387202d5e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:17.128707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f45ab7ff-41d8-49aa-a4a3-ccf387202d5e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:17.188031 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f45ab7ff-41d8-49aa-a4a3-ccf387202d5e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:17.195204 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f45ab7ff-41d8-49aa-a4a3-ccf387202d5e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1185 microversion: 2.1 time: 0.079018 Jun 20 18:49:17.195748 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 161/339] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:17 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:17.525469 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8db73798-9055-4929-8bd8-8f7610177a97 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:17.526069 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8db73798-9055-4929-8bd8-8f7610177a97 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:17.533108 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8db73798-9055-4929-8bd8-8f7610177a97 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:17.533547 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8db73798-9055-4929-8bd8-8f7610177a97 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:17.534288 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8db73798-9055-4929-8bd8-8f7610177a97 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:17.534715 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8db73798-9055-4929-8bd8-8f7610177a97 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:17.544264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-99765392-3b78-4f41-ac43-c952df56cf5b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:17.545410 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-99765392-3b78-4f41-ac43-c952df56cf5b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:17.552159 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-99765392-3b78-4f41-ac43-c952df56cf5b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:17.552607 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-99765392-3b78-4f41-ac43-c952df56cf5b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:17.553374 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-99765392-3b78-4f41-ac43-c952df56cf5b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:17.553809 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-99765392-3b78-4f41-ac43-c952df56cf5b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:17.675108 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8db73798-9055-4929-8bd8-8f7610177a97 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:17.682510 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-99765392-3b78-4f41-ac43-c952df56cf5b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:17.682689 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8db73798-9055-4929-8bd8-8f7610177a97 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.160991 Jun 20 18:49:17.683225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 179/340] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:17 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:17.690550 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-99765392-3b78-4f41-ac43-c952df56cf5b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.150146 Jun 20 18:49:17.691118 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 162/341] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:17 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:18.212940 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-cd4c8390-1ea8-4235-a5c2-b62e8a881185 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:18.213678 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-cd4c8390-1ea8-4235-a5c2-b62e8a881185 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:18.220383 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cd4c8390-1ea8-4235-a5c2-b62e8a881185 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:18.220827 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cd4c8390-1ea8-4235-a5c2-b62e8a881185 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:18.221582 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cd4c8390-1ea8-4235-a5c2-b62e8a881185 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:18.222037 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cd4c8390-1ea8-4235-a5c2-b62e8a881185 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:18.283934 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cd4c8390-1ea8-4235-a5c2-b62e8a881185 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:18.291560 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-cd4c8390-1ea8-4235-a5c2-b62e8a881185 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1185 microversion: 2.1 time: 0.082588 Jun 20 18:49:18.292111 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 180/342] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:18 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:18.700060 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-42568372-8bd7-4874-b3ec-92471d05a752 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:18.701953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-42568372-8bd7-4874-b3ec-92471d05a752 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:18.706936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e0c3b107-380e-4b3a-8174-0778c9b2c205 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:18.707542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e0c3b107-380e-4b3a-8174-0778c9b2c205 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:18.708755 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-42568372-8bd7-4874-b3ec-92471d05a752 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:18.709202 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-42568372-8bd7-4874-b3ec-92471d05a752 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:18.709989 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-42568372-8bd7-4874-b3ec-92471d05a752 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:18.710420 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-42568372-8bd7-4874-b3ec-92471d05a752 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:18.714243 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0c3b107-380e-4b3a-8174-0778c9b2c205 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:18.714691 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0c3b107-380e-4b3a-8174-0778c9b2c205 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:18.715568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0c3b107-380e-4b3a-8174-0778c9b2c205 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:18.715964 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0c3b107-380e-4b3a-8174-0778c9b2c205 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:18.869928 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e0c3b107-380e-4b3a-8174-0778c9b2c205 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:18.877988 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e0c3b107-380e-4b3a-8174-0778c9b2c205 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.174794 Jun 20 18:49:18.878554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 181/343] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:18 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:19.021779 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-42568372-8bd7-4874-b3ec-92471d05a752 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:19.029902 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-42568372-8bd7-4874-b3ec-92471d05a752 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.333664 Jun 20 18:49:19.030455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 163/344] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:18 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:19.307714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d9833450-08d9-4910-a9bb-01b2fbf2cab8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:19.308399 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d9833450-08d9-4910-a9bb-01b2fbf2cab8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:19.319713 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d9833450-08d9-4910-a9bb-01b2fbf2cab8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:19.321730 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d9833450-08d9-4910-a9bb-01b2fbf2cab8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:19.323256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d9833450-08d9-4910-a9bb-01b2fbf2cab8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:19.323826 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d9833450-08d9-4910-a9bb-01b2fbf2cab8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:19.438212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d9833450-08d9-4910-a9bb-01b2fbf2cab8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:19.447298 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d9833450-08d9-4910-a9bb-01b2fbf2cab8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1185 microversion: 2.1 time: 0.143281 Jun 20 18:49:19.447874 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 182/345] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:19 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:19.895237 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-565611bb-fcf7-4d2b-92aa-f6b89b2cc70c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:19.895852 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-565611bb-fcf7-4d2b-92aa-f6b89b2cc70c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:19.902237 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-565611bb-fcf7-4d2b-92aa-f6b89b2cc70c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:19.902688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-565611bb-fcf7-4d2b-92aa-f6b89b2cc70c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:19.903500 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-565611bb-fcf7-4d2b-92aa-f6b89b2cc70c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:19.903923 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-565611bb-fcf7-4d2b-92aa-f6b89b2cc70c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:19.936429 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0d5a76d9-f114-4abd-89fb-a703effe0b57 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1221cdb8-8254-4493-9611-77278ace9eef"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:19.937682 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0d5a76d9-f114-4abd-89fb-a703effe0b57 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:19.944305 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0d5a76d9-f114-4abd-89fb-a703effe0b57 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:19.944828 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0d5a76d9-f114-4abd-89fb-a703effe0b57 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:19.945694 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0d5a76d9-f114-4abd-89fb-a703effe0b57 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:19.946214 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0d5a76d9-f114-4abd-89fb-a703effe0b57 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:20.032922 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-565611bb-fcf7-4d2b-92aa-f6b89b2cc70c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:20.041224 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-565611bb-fcf7-4d2b-92aa-f6b89b2cc70c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.149931 Jun 20 18:49:20.041871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 164/346] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:19 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:20.046344 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6d9d735a-7d3b-4db3-abde-f459dae7fcb2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:20.046961 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6d9d735a-7d3b-4db3-abde-f459dae7fcb2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:20.052570 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6d9d735a-7d3b-4db3-abde-f459dae7fcb2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:20.053007 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6d9d735a-7d3b-4db3-abde-f459dae7fcb2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:20.053753 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6d9d735a-7d3b-4db3-abde-f459dae7fcb2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:20.054179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6d9d735a-7d3b-4db3-abde-f459dae7fcb2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:20.184634 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6d9d735a-7d3b-4db3-abde-f459dae7fcb2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:20.192614 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6d9d735a-7d3b-4db3-abde-f459dae7fcb2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.149771 Jun 20 18:49:20.193174 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 165/347] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:20 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:20.463658 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-44a01091-1dbd-49cf-acec-dd0a6dbbfe51 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:20.464264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-44a01091-1dbd-49cf-acec-dd0a6dbbfe51 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:20.470563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44a01091-1dbd-49cf-acec-dd0a6dbbfe51 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:20.471050 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44a01091-1dbd-49cf-acec-dd0a6dbbfe51 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:20.471805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44a01091-1dbd-49cf-acec-dd0a6dbbfe51 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:20.472251 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44a01091-1dbd-49cf-acec-dd0a6dbbfe51 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:20.539676 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-44a01091-1dbd-49cf-acec-dd0a6dbbfe51 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:20.546994 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-44a01091-1dbd-49cf-acec-dd0a6dbbfe51 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1185 microversion: 2.1 time: 0.087031 Jun 20 18:49:20.547596 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 166/348] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:20 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:21.058034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8cbc663f-91bd-48d2-8401-aa9d3e8106c6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:21.058676 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8cbc663f-91bd-48d2-8401-aa9d3e8106c6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:21.065693 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8cbc663f-91bd-48d2-8401-aa9d3e8106c6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:21.066132 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8cbc663f-91bd-48d2-8401-aa9d3e8106c6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:21.066886 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8cbc663f-91bd-48d2-8401-aa9d3e8106c6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:21.067345 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8cbc663f-91bd-48d2-8401-aa9d3e8106c6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:21.191552 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8cbc663f-91bd-48d2-8401-aa9d3e8106c6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:21.198756 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8cbc663f-91bd-48d2-8401-aa9d3e8106c6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.144594 Jun 20 18:49:21.199344 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 167/349] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:21 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:21.208651 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ab6e8423-e418-40c8-a755-b3cc8768f45e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:21.209241 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ab6e8423-e418-40c8-a755-b3cc8768f45e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:21.214812 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ab6e8423-e418-40c8-a755-b3cc8768f45e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:21.215301 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ab6e8423-e418-40c8-a755-b3cc8768f45e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:21.216053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ab6e8423-e418-40c8-a755-b3cc8768f45e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:21.216650 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ab6e8423-e418-40c8-a755-b3cc8768f45e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:21.341597 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ab6e8423-e418-40c8-a755-b3cc8768f45e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:21.348952 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ab6e8423-e418-40c8-a755-b3cc8768f45e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.143775 Jun 20 18:49:21.349502 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 168/350] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:21 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:21.564305 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-55efa336-ea48-449e-9b3e-ba8ab3859082 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:21.564915 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-55efa336-ea48-449e-9b3e-ba8ab3859082 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:21.570883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-55efa336-ea48-449e-9b3e-ba8ab3859082 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:21.571429 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-55efa336-ea48-449e-9b3e-ba8ab3859082 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:21.572186 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-55efa336-ea48-449e-9b3e-ba8ab3859082 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:21.572619 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-55efa336-ea48-449e-9b3e-ba8ab3859082 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:21.634429 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-55efa336-ea48-449e-9b3e-ba8ab3859082 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:21.641751 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-55efa336-ea48-449e-9b3e-ba8ab3859082 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1185 microversion: 2.1 time: 0.081303 Jun 20 18:49:21.642298 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 169/351] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:21 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:22.215567 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-82471976-0266-479a-8c75-576f774e6998 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:22.216191 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-82471976-0266-479a-8c75-576f774e6998 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:22.222617 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-82471976-0266-479a-8c75-576f774e6998 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:22.223110 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-82471976-0266-479a-8c75-576f774e6998 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:22.223867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-82471976-0266-479a-8c75-576f774e6998 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:22.224304 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-82471976-0266-479a-8c75-576f774e6998 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:22.349377 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-82471976-0266-479a-8c75-576f774e6998 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:22.356708 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-82471976-0266-479a-8c75-576f774e6998 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.145043 Jun 20 18:49:22.357857 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 170/352] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:22 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:22.365551 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e9c8130a-b4b5-4232-9bba-03ab35290b56 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:22.366145 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e9c8130a-b4b5-4232-9bba-03ab35290b56 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:22.371999 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e9c8130a-b4b5-4232-9bba-03ab35290b56 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:22.372440 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e9c8130a-b4b5-4232-9bba-03ab35290b56 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:22.373217 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e9c8130a-b4b5-4232-9bba-03ab35290b56 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:22.373648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e9c8130a-b4b5-4232-9bba-03ab35290b56 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:22.501228 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e9c8130a-b4b5-4232-9bba-03ab35290b56 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:22.508481 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e9c8130a-b4b5-4232-9bba-03ab35290b56 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.146978 Jun 20 18:49:22.509030 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 171/353] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:22 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:22.658434 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9ed2990e-fbc4-4802-a4e3-59752dee4788 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:22.659060 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9ed2990e-fbc4-4802-a4e3-59752dee4788 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:22.665279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9ed2990e-fbc4-4802-a4e3-59752dee4788 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:22.665728 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9ed2990e-fbc4-4802-a4e3-59752dee4788 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:22.666502 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9ed2990e-fbc4-4802-a4e3-59752dee4788 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:22.666941 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9ed2990e-fbc4-4802-a4e3-59752dee4788 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:22.728957 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9ed2990e-fbc4-4802-a4e3-59752dee4788 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:22.737362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9ed2990e-fbc4-4802-a4e3-59752dee4788 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1193 microversion: 2.1 time: 0.082700 Jun 20 18:49:22.737903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 172/354] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:22 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:23.374082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0559fa90-d73b-470b-9205-9b0c0722a291 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:23.374742 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0559fa90-d73b-470b-9205-9b0c0722a291 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:23.381564 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0559fa90-d73b-470b-9205-9b0c0722a291 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:23.382002 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0559fa90-d73b-470b-9205-9b0c0722a291 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:23.382753 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0559fa90-d73b-470b-9205-9b0c0722a291 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:23.383206 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0559fa90-d73b-470b-9205-9b0c0722a291 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:23.511068 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0559fa90-d73b-470b-9205-9b0c0722a291 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:23.518857 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0559fa90-d73b-470b-9205-9b0c0722a291 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.149220 Jun 20 18:49:23.519451 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 173/355] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:23 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:23.525065 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-2badbda1-a08c-4792-919d-a4c8146ccd7e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:23.525664 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-2badbda1-a08c-4792-919d-a4c8146ccd7e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:23.531914 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2badbda1-a08c-4792-919d-a4c8146ccd7e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:23.532365 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2badbda1-a08c-4792-919d-a4c8146ccd7e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:23.533119 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2badbda1-a08c-4792-919d-a4c8146ccd7e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:23.533554 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2badbda1-a08c-4792-919d-a4c8146ccd7e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:23.668751 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-2badbda1-a08c-4792-919d-a4c8146ccd7e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:23.676862 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-2badbda1-a08c-4792-919d-a4c8146ccd7e tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.155372 Jun 20 18:49:23.677983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 174/356] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:23 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:23.753527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4d1e38d2-f5e4-45f8-85bc-c0c433507ba1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:23.754128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-4d1e38d2-f5e4-45f8-85bc-c0c433507ba1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:23.760362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4d1e38d2-f5e4-45f8-85bc-c0c433507ba1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:23.760810 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4d1e38d2-f5e4-45f8-85bc-c0c433507ba1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:23.761557 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4d1e38d2-f5e4-45f8-85bc-c0c433507ba1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:23.761984 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4d1e38d2-f5e4-45f8-85bc-c0c433507ba1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:23.820816 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-4d1e38d2-f5e4-45f8-85bc-c0c433507ba1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:23.828051 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4d1e38d2-f5e4-45f8-85bc-c0c433507ba1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1193 microversion: 2.1 time: 0.078478 Jun 20 18:49:23.828610 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 175/357] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:23 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1193 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:24.535610 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c01ba73a-d2df-442f-a61e-0003d5b74a92 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:24.536225 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c01ba73a-d2df-442f-a61e-0003d5b74a92 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:24.543138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c01ba73a-d2df-442f-a61e-0003d5b74a92 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:24.543592 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c01ba73a-d2df-442f-a61e-0003d5b74a92 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:24.544952 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c01ba73a-d2df-442f-a61e-0003d5b74a92 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:24.545392 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c01ba73a-d2df-442f-a61e-0003d5b74a92 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:24.549550 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:24.677858 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c01ba73a-d2df-442f-a61e-0003d5b74a92 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:24.685791 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c01ba73a-d2df-442f-a61e-0003d5b74a92 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.153908 Jun 20 18:49:24.686290 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 176/358] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:24 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:24.701515 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b1c43c68-ff2d-48c9-acae-2d1501bc2e58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:24.702792 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b1c43c68-ff2d-48c9-acae-2d1501bc2e58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:24.708936 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b1c43c68-ff2d-48c9-acae-2d1501bc2e58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:24.709383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b1c43c68-ff2d-48c9-acae-2d1501bc2e58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:24.710153 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b1c43c68-ff2d-48c9-acae-2d1501bc2e58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:24.710599 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b1c43c68-ff2d-48c9-acae-2d1501bc2e58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:24.851307 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b1c43c68-ff2d-48c9-acae-2d1501bc2e58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:24.859382 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b1c43c68-ff2d-48c9-acae-2d1501bc2e58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.163727 Jun 20 18:49:24.859944 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 177/359] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:24 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:24.864248 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6661d93f-ed23-4831-9499-7ad29b8ba4fd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:24.864856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6661d93f-ed23-4831-9499-7ad29b8ba4fd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:24.870424 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6661d93f-ed23-4831-9499-7ad29b8ba4fd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:24.870873 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6661d93f-ed23-4831-9499-7ad29b8ba4fd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:24.871663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6661d93f-ed23-4831-9499-7ad29b8ba4fd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:24.872131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6661d93f-ed23-4831-9499-7ad29b8ba4fd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:24.932048 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6661d93f-ed23-4831-9499-7ad29b8ba4fd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:24.939425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6661d93f-ed23-4831-9499-7ad29b8ba4fd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1203 microversion: 2.1 time: 0.078540 Jun 20 18:49:24.939999 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 178/360] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:24 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1203 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:24.986043 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:25.128881 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0d5a76d9-f114-4abd-89fb-a703effe0b57 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "POST /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.196768 Jun 20 18:49:25.129754 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 183/361] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jun 20 18:49:19 2022] POST /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a/os-volume_attachments => generated 194 bytes in 5198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:49:25.706450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-026b0084-94a5-4e79-8485-64830f707ece tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:25.707121 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-026b0084-94a5-4e79-8485-64830f707ece tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:25.713149 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-026b0084-94a5-4e79-8485-64830f707ece tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:25.713601 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-026b0084-94a5-4e79-8485-64830f707ece tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:25.714370 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-026b0084-94a5-4e79-8485-64830f707ece tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:25.714812 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-026b0084-94a5-4e79-8485-64830f707ece tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:25.753774 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2937b9ac-e4f6-4268-b36a-61730c8968cc tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8d36d3e-21e7-4e0b-a5b8-d4666ac391c4"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:25.755380 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2937b9ac-e4f6-4268-b36a-61730c8968cc tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:25.763364 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2937b9ac-e4f6-4268-b36a-61730c8968cc tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:25.763813 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2937b9ac-e4f6-4268-b36a-61730c8968cc tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:25.764576 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2937b9ac-e4f6-4268-b36a-61730c8968cc tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:25.765009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2937b9ac-e4f6-4268-b36a-61730c8968cc tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:25.869305 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-026b0084-94a5-4e79-8485-64830f707ece tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:25.877356 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-026b0084-94a5-4e79-8485-64830f707ece tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.179633 Jun 20 18:49:25.877904 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 179/362] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:25 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:25.882390 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-41e1a1a2-00a9-4a5f-8b53-f87b8a0098a9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:25.882979 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-41e1a1a2-00a9-4a5f-8b53-f87b8a0098a9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:25.889806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-41e1a1a2-00a9-4a5f-8b53-f87b8a0098a9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:25.890250 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-41e1a1a2-00a9-4a5f-8b53-f87b8a0098a9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:25.891031 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-41e1a1a2-00a9-4a5f-8b53-f87b8a0098a9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:25.891466 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-41e1a1a2-00a9-4a5f-8b53-f87b8a0098a9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:26.021144 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-41e1a1a2-00a9-4a5f-8b53-f87b8a0098a9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:26.028415 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-41e1a1a2-00a9-4a5f-8b53-f87b8a0098a9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.149530 Jun 20 18:49:26.029480 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 180/363] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:25 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:26.033755 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-03c1a375-dfc1-46a0-957f-f10e66bf079f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:26.034345 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-03c1a375-dfc1-46a0-957f-f10e66bf079f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:26.040111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-03c1a375-dfc1-46a0-957f-f10e66bf079f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:26.040560 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-03c1a375-dfc1-46a0-957f-f10e66bf079f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:26.041312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-03c1a375-dfc1-46a0-957f-f10e66bf079f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:26.041744 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-03c1a375-dfc1-46a0-957f-f10e66bf079f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:26.171197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-03c1a375-dfc1-46a0-957f-f10e66bf079f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:26.178556 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-03c1a375-dfc1-46a0-957f-f10e66bf079f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1270 microversion: 2.1 time: 0.148144 Jun 20 18:49:26.179206 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 181/364] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:26 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1270 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:26.893421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9e4c1878-3292-4038-84af-c405c0e71588 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:26.894022 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9e4c1878-3292-4038-84af-c405c0e71588 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:26.900381 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9e4c1878-3292-4038-84af-c405c0e71588 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:26.900822 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9e4c1878-3292-4038-84af-c405c0e71588 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:26.901569 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9e4c1878-3292-4038-84af-c405c0e71588 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:26.901998 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9e4c1878-3292-4038-84af-c405c0e71588 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:27.029714 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9e4c1878-3292-4038-84af-c405c0e71588 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:27.036997 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9e4c1878-3292-4038-84af-c405c0e71588 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.147331 Jun 20 18:49:27.037545 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 182/365] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:26 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:27.045865 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f715b981-6ada-4c35-83cc-2a6cdcb6f775 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:27.046463 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f715b981-6ada-4c35-83cc-2a6cdcb6f775 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:27.052192 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f715b981-6ada-4c35-83cc-2a6cdcb6f775 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:27.052629 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f715b981-6ada-4c35-83cc-2a6cdcb6f775 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:27.053372 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f715b981-6ada-4c35-83cc-2a6cdcb6f775 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:27.053799 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f715b981-6ada-4c35-83cc-2a6cdcb6f775 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:27.177821 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f715b981-6ada-4c35-83cc-2a6cdcb6f775 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:27.185628 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f715b981-6ada-4c35-83cc-2a6cdcb6f775 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.143100 Jun 20 18:49:27.186182 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 183/366] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:27 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:27.195507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-144318ae-8f9b-4788-b183-42593e41f41f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:27.196100 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-144318ae-8f9b-4788-b183-42593e41f41f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:27.201646 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-144318ae-8f9b-4788-b183-42593e41f41f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:27.202087 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-144318ae-8f9b-4788-b183-42593e41f41f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:27.202833 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-144318ae-8f9b-4788-b183-42593e41f41f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:27.203281 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-144318ae-8f9b-4788-b183-42593e41f41f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:27.332882 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-144318ae-8f9b-4788-b183-42593e41f41f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:27.340173 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-144318ae-8f9b-4788-b183-42593e41f41f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1270 microversion: 2.1 time: 0.148440 Jun 20 18:49:27.340718 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 184/367] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:27 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:28.054392 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5bc50bce-4883-456a-832b-ae3e9bcf496a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:28.055053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5bc50bce-4883-456a-832b-ae3e9bcf496a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:28.062104 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5bc50bce-4883-456a-832b-ae3e9bcf496a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:28.062551 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5bc50bce-4883-456a-832b-ae3e9bcf496a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:28.063332 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5bc50bce-4883-456a-832b-ae3e9bcf496a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:28.063766 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5bc50bce-4883-456a-832b-ae3e9bcf496a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:28.197611 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5bc50bce-4883-456a-832b-ae3e9bcf496a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:28.205024 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5bc50bce-4883-456a-832b-ae3e9bcf496a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.154431 Jun 20 18:49:28.205568 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 185/368] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:28 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:28.209956 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c2fba1fb-37d3-4e09-987c-3af7dc2e0d7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:28.210542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c2fba1fb-37d3-4e09-987c-3af7dc2e0d7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:28.216505 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2fba1fb-37d3-4e09-987c-3af7dc2e0d7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:28.216944 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2fba1fb-37d3-4e09-987c-3af7dc2e0d7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:28.217697 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2fba1fb-37d3-4e09-987c-3af7dc2e0d7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:28.218122 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2fba1fb-37d3-4e09-987c-3af7dc2e0d7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:28.345884 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c2fba1fb-37d3-4e09-987c-3af7dc2e0d7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:28.353453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c2fba1fb-37d3-4e09-987c-3af7dc2e0d7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.146898 Jun 20 18:49:28.354002 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 186/369] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:28 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:28.359044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7db45c3c-cc43-4aa6-b30e-decc33786e8c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:28.359559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7db45c3c-cc43-4aa6-b30e-decc33786e8c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:28.365105 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7db45c3c-cc43-4aa6-b30e-decc33786e8c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:28.365551 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7db45c3c-cc43-4aa6-b30e-decc33786e8c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:28.366302 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7db45c3c-cc43-4aa6-b30e-decc33786e8c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:28.366733 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7db45c3c-cc43-4aa6-b30e-decc33786e8c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:28.389956 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7db45c3c-cc43-4aa6-b30e-decc33786e8c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/ips" status: 200 len: 152 microversion: 2.20 time: 0.035000 Jun 20 18:49:28.390497 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 187/370] 10.222.0.43 () {60 vars in 1288 bytes} [Mon Jun 20 18:49:28 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:49:28.394655 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f2720737-f8bb-4bb3-95d5-33bfb723395d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:28.395274 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f2720737-f8bb-4bb3-95d5-33bfb723395d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:28.400834 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f2720737-f8bb-4bb3-95d5-33bfb723395d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:28.401278 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f2720737-f8bb-4bb3-95d5-33bfb723395d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:28.402023 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f2720737-f8bb-4bb3-95d5-33bfb723395d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:28.402454 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f2720737-f8bb-4bb3-95d5-33bfb723395d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:28.541623 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f2720737-f8bb-4bb3-95d5-33bfb723395d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:28.551978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f2720737-f8bb-4bb3-95d5-33bfb723395d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1270 microversion: 2.1 time: 0.160275 Jun 20 18:49:28.552550 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 188/371] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:28 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:29.222102 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e9c3f52e-45cc-42c1-8365-890c634401af tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:29.222767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e9c3f52e-45cc-42c1-8365-890c634401af tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:29.229129 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e9c3f52e-45cc-42c1-8365-890c634401af tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:29.229580 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e9c3f52e-45cc-42c1-8365-890c634401af tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:29.230333 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e9c3f52e-45cc-42c1-8365-890c634401af tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:29.230769 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e9c3f52e-45cc-42c1-8365-890c634401af tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:29.404811 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e9c3f52e-45cc-42c1-8365-890c634401af tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:29.422248 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e9c3f52e-45cc-42c1-8365-890c634401af tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1521 microversion: 2.1 time: 0.203931 Jun 20 18:49:29.432919 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 189/372] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:29 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:29.438400 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ed8a06cc-c8ae-4ff7-9f58-fe161eceae7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:29.439128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ed8a06cc-c8ae-4ff7-9f58-fe161eceae7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:29.446848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed8a06cc-c8ae-4ff7-9f58-fe161eceae7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:29.447325 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed8a06cc-c8ae-4ff7-9f58-fe161eceae7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:29.448101 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed8a06cc-c8ae-4ff7-9f58-fe161eceae7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:29.448718 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed8a06cc-c8ae-4ff7-9f58-fe161eceae7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:29.697956 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ed8a06cc-c8ae-4ff7-9f58-fe161eceae7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:29.707008 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ed8a06cc-c8ae-4ff7-9f58-fe161eceae7c tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.272891 Jun 20 18:49:29.707579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 190/373] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:29 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:29.712668 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-2318cc15-fa6d-4211-a2cb-baa7450300f1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:29.713419 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-2318cc15-fa6d-4211-a2cb-baa7450300f1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:29.721663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2318cc15-fa6d-4211-a2cb-baa7450300f1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:29.722115 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2318cc15-fa6d-4211-a2cb-baa7450300f1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:29.722887 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2318cc15-fa6d-4211-a2cb-baa7450300f1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:29.723473 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2318cc15-fa6d-4211-a2cb-baa7450300f1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:30.184444 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-2318cc15-fa6d-4211-a2cb-baa7450300f1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:30.197098 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-2318cc15-fa6d-4211-a2cb-baa7450300f1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1270 microversion: 2.1 time: 0.487382 Jun 20 18:49:30.198055 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 191/374] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:29 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1270 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:30.293908 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2937b9ac-e4f6-4268-b36a-61730c8968cc tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "POST /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.544072 Jun 20 18:49:30.299529 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 184/375] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jun 20 18:49:25 2022] POST /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/os-volume_attachments => generated 194 bytes in 4551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:49:30.423349 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-5c64a207-3de0-4f4d-99d1-71521862efbe req-76571606-1049-4e66-b796-a90d08ca762e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85165412-e44c-453d-aa22-d248bff1a459", "tag": "12fa4b8e-1393-46da-afb1-ff594d0231e6"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:30.432027 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-5c64a207-3de0-4f4d-99d1-71521862efbe req-76571606-1049-4e66-b796-a90d08ca762e service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:30.432466 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-5c64a207-3de0-4f4d-99d1-71521862efbe req-76571606-1049-4e66-b796-a90d08ca762e service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:30.444108 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4a2862a9-b523-4a39-9410-e211c075b2ce tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:30.448868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-5c64a207-3de0-4f4d-99d1-71521862efbe req-76571606-1049-4e66-b796-a90d08ca762e service nova] Creating event network-changed:12fa4b8e-1393-46da-afb1-ff594d0231e6 for instance 85165412-e44c-453d-aa22-d248bff1a459 on hv-cinder-83697 Jun 20 18:49:30.454665 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-4a2862a9-b523-4a39-9410-e211c075b2ce tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:30.455158 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-5c64a207-3de0-4f4d-99d1-71521862efbe req-76571606-1049-4e66-b796-a90d08ca762e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036685 Jun 20 18:49:30.456074 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 192/376] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:49:30.466436 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a2862a9-b523-4a39-9410-e211c075b2ce tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:30.466890 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a2862a9-b523-4a39-9410-e211c075b2ce tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:30.467808 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a2862a9-b523-4a39-9410-e211c075b2ce tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:30.468244 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a2862a9-b523-4a39-9410-e211c075b2ce tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:30.666717 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4a2862a9-b523-4a39-9410-e211c075b2ce tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:30.674860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4a2862a9-b523-4a39-9410-e211c075b2ce tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1501 microversion: 2.1 time: 0.238427 Jun 20 18:49:30.675442 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 185/377] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:30 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1501 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:30.690957 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1884c9c3-31a4-40a9-98e3-c6641940e697 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:30.691662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1884c9c3-31a4-40a9-98e3-c6641940e697 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:30.698001 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1884c9c3-31a4-40a9-98e3-c6641940e697 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:30.698449 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1884c9c3-31a4-40a9-98e3-c6641940e697 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:30.699238 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1884c9c3-31a4-40a9-98e3-c6641940e697 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:30.699674 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1884c9c3-31a4-40a9-98e3-c6641940e697 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:30.723584 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0447d1a5-fc28-408e-a970-bd7740c7f804 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:30.724183 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0447d1a5-fc28-408e-a970-bd7740c7f804 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:30.730782 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0447d1a5-fc28-408e-a970-bd7740c7f804 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:30.731256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0447d1a5-fc28-408e-a970-bd7740c7f804 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:30.732065 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0447d1a5-fc28-408e-a970-bd7740c7f804 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:30.732495 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0447d1a5-fc28-408e-a970-bd7740c7f804 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:30.835861 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1884c9c3-31a4-40a9-98e3-c6641940e697 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:30.838267 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:30.845521 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1884c9c3-31a4-40a9-98e3-c6641940e697 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1515 microversion: 2.1 time: 0.158717 Jun 20 18:49:30.846083 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 193/378] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:30 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:30.869662 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0447d1a5-fc28-408e-a970-bd7740c7f804 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:30.877564 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0447d1a5-fc28-408e-a970-bd7740c7f804 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.157799 Jun 20 18:49:30.878204 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 186/379] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:30 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:31.216497 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-499c35b0-b82c-4d30-ab0b-345367e75db8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:31.217089 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-499c35b0-b82c-4d30-ab0b-345367e75db8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:31.223163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-499c35b0-b82c-4d30-ab0b-345367e75db8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:31.223611 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-499c35b0-b82c-4d30-ab0b-345367e75db8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:31.224364 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-499c35b0-b82c-4d30-ab0b-345367e75db8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:31.224794 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-499c35b0-b82c-4d30-ab0b-345367e75db8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:31.352587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-499c35b0-b82c-4d30-ab0b-345367e75db8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:31.360033 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-499c35b0-b82c-4d30-ab0b-345367e75db8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1270 microversion: 2.1 time: 0.147435 Jun 20 18:49:31.360583 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 194/380] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:31 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1270 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:31.894166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e02fd73f-0666-4660-963e-5c1aea86157b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:31.894766 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e02fd73f-0666-4660-963e-5c1aea86157b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:31.901501 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e02fd73f-0666-4660-963e-5c1aea86157b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:31.901938 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e02fd73f-0666-4660-963e-5c1aea86157b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:31.902683 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e02fd73f-0666-4660-963e-5c1aea86157b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:31.903152 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e02fd73f-0666-4660-963e-5c1aea86157b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:32.027230 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e02fd73f-0666-4660-963e-5c1aea86157b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:32.035180 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e02fd73f-0666-4660-963e-5c1aea86157b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.144806 Jun 20 18:49:32.035739 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 187/381] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:31 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:32.352729 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-691d4922-e8a1-43de-9afe-48588757143b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:32.353269 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-691d4922-e8a1-43de-9afe-48588757143b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:32.360312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-691d4922-e8a1-43de-9afe-48588757143b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:32.360773 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-691d4922-e8a1-43de-9afe-48588757143b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:32.361511 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-691d4922-e8a1-43de-9afe-48588757143b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:32.361943 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-691d4922-e8a1-43de-9afe-48588757143b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:32.377186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-03cfca2a-468b-4bef-b501-39f99aaf5038 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:32.377858 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-03cfca2a-468b-4bef-b501-39f99aaf5038 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:32.384030 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-03cfca2a-468b-4bef-b501-39f99aaf5038 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:32.384469 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-03cfca2a-468b-4bef-b501-39f99aaf5038 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:32.385225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-03cfca2a-468b-4bef-b501-39f99aaf5038 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:32.385656 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-03cfca2a-468b-4bef-b501-39f99aaf5038 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:32.386414 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-691d4922-e8a1-43de-9afe-48588757143b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lazy-loading 'flavor' on Instance uuid aa52c387-5b77-4644-85c8-691b22dfeb78 {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:49:32.532128 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-03cfca2a-468b-4bef-b501-39f99aaf5038 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:32.540936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-03cfca2a-468b-4bef-b501-39f99aaf5038 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1270 microversion: 2.1 time: 0.167510 Jun 20 18:49:32.541524 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 188/382] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:32 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:32.667308 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-691d4922-e8a1-43de-9afe-48588757143b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "POST /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/action" status: 202 len: 0 microversion: 2.20 time: 0.318220 Jun 20 18:49:32.670827 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 195/383] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Jun 20 18:49:32 2022] POST /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:49:32.675784 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-cc310b24-30a6-4296-b309-b1f490af386e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:32.676394 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-cc310b24-30a6-4296-b309-b1f490af386e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:32.682339 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cc310b24-30a6-4296-b309-b1f490af386e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:32.682789 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cc310b24-30a6-4296-b309-b1f490af386e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:32.683579 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cc310b24-30a6-4296-b309-b1f490af386e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:32.684016 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cc310b24-30a6-4296-b309-b1f490af386e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:32.809153 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cc310b24-30a6-4296-b309-b1f490af386e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:32.817619 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cc310b24-30a6-4296-b309-b1f490af386e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:32.819164 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cc310b24-30a6-4296-b309-b1f490af386e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:32.820326 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-cc310b24-30a6-4296-b309-b1f490af386e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.148352 Jun 20 18:49:32.820879 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 189/384] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:32 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:33.053267 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7615ee0a-4866-426e-a9e2-d1c3f7fcf0a8 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:33.053958 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7615ee0a-4866-426e-a9e2-d1c3f7fcf0a8 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:33.060783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7615ee0a-4866-426e-a9e2-d1c3f7fcf0a8 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:33.061220 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7615ee0a-4866-426e-a9e2-d1c3f7fcf0a8 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:33.061967 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7615ee0a-4866-426e-a9e2-d1c3f7fcf0a8 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:33.062393 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7615ee0a-4866-426e-a9e2-d1c3f7fcf0a8 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:33.192521 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7615ee0a-4866-426e-a9e2-d1c3f7fcf0a8 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:33.199793 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7615ee0a-4866-426e-a9e2-d1c3f7fcf0a8 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.150920 Jun 20 18:49:33.200339 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 196/385] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:33 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:33.258095 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0c0dba90-0f68-41c9-aeb0-69975327098f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:33.259136 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0c0dba90-0f68-41c9-aeb0-69975327098f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:33.266010 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0c0dba90-0f68-41c9-aeb0-69975327098f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:33.266454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0c0dba90-0f68-41c9-aeb0-69975327098f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:33.267239 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0c0dba90-0f68-41c9-aeb0-69975327098f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:33.267678 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0c0dba90-0f68-41c9-aeb0-69975327098f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:33.290577 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-0c0dba90-0f68-41c9-aeb0-69975327098f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lazy-loading 'flavor' on Instance uuid 4a86d158-0870-4597-be67-25d4f9371977 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:49:33.400296 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0c0dba90-0f68-41c9-aeb0-69975327098f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "POST /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977/action" status: 200 len: 32 microversion: 2.1 time: 0.146174 Jun 20 18:49:33.400890 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 190/386] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jun 20 18:49:33 2022] POST /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977/action => generated 32 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 18:49:33.409972 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8a124a16-4d66-4774-a616-6068ae99b144 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:33.410570 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8a124a16-4d66-4774-a616-6068ae99b144 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:33.418052 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a124a16-4d66-4774-a616-6068ae99b144 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:33.418596 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a124a16-4d66-4774-a616-6068ae99b144 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:33.419424 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a124a16-4d66-4774-a616-6068ae99b144 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:33.419982 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a124a16-4d66-4774-a616-6068ae99b144 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:33.552929 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8a124a16-4d66-4774-a616-6068ae99b144 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:33.559248 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9c5a9319-f061-436b-ad57-418a4ac4a277 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:33.559950 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9c5a9319-f061-436b-ad57-418a4ac4a277 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:33.560830 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8a124a16-4d66-4774-a616-6068ae99b144 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.154788 Jun 20 18:49:33.561555 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 197/387] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:33 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:33.566034 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9c5a9319-f061-436b-ad57-418a4ac4a277 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:33.566479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9c5a9319-f061-436b-ad57-418a4ac4a277 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:33.567263 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9c5a9319-f061-436b-ad57-418a4ac4a277 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:33.567702 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9c5a9319-f061-436b-ad57-418a4ac4a277 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:33.708539 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9c5a9319-f061-436b-ad57-418a4ac4a277 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:33.718551 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9c5a9319-f061-436b-ad57-418a4ac4a277 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1270 microversion: 2.1 time: 0.163265 Jun 20 18:49:33.719579 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 191/388] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:33 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:33.839526 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b4ba4741-8deb-4be7-95c9-133b59995f20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:33.840129 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b4ba4741-8deb-4be7-95c9-133b59995f20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:33.846901 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b4ba4741-8deb-4be7-95c9-133b59995f20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:33.847373 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b4ba4741-8deb-4be7-95c9-133b59995f20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:33.848116 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b4ba4741-8deb-4be7-95c9-133b59995f20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:33.848541 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b4ba4741-8deb-4be7-95c9-133b59995f20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:33.975987 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b4ba4741-8deb-4be7-95c9-133b59995f20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:33.983872 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b4ba4741-8deb-4be7-95c9-133b59995f20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:33.985355 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b4ba4741-8deb-4be7-95c9-133b59995f20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:33.986483 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b4ba4741-8deb-4be7-95c9-133b59995f20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.151022 Jun 20 18:49:33.987051 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 198/389] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:33 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:34.216543 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ac6d6ec7-edb1-4118-8336-40668abcf0a6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:34.217067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ac6d6ec7-edb1-4118-8336-40668abcf0a6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:34.222996 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ac6d6ec7-edb1-4118-8336-40668abcf0a6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:34.223445 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ac6d6ec7-edb1-4118-8336-40668abcf0a6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:34.224217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ac6d6ec7-edb1-4118-8336-40668abcf0a6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:34.224657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ac6d6ec7-edb1-4118-8336-40668abcf0a6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:34.350237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ac6d6ec7-edb1-4118-8336-40668abcf0a6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:34.357600 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ac6d6ec7-edb1-4118-8336-40668abcf0a6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.145108 Jun 20 18:49:34.358160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 192/390] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:34 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:34.478825 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-77aaadb4-fb9d-40bd-bda3-898ccac9b3a2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:34.479618 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-77aaadb4-fb9d-40bd-bda3-898ccac9b3a2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:34.486614 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-77aaadb4-fb9d-40bd-bda3-898ccac9b3a2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:34.487282 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-77aaadb4-fb9d-40bd-bda3-898ccac9b3a2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:34.488517 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-77aaadb4-fb9d-40bd-bda3-898ccac9b3a2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:34.488957 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-77aaadb4-fb9d-40bd-bda3-898ccac9b3a2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:34.577242 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0af45e0c-b29d-4d45-9917-a878f514b38a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:34.577852 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0af45e0c-b29d-4d45-9917-a878f514b38a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:34.583768 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0af45e0c-b29d-4d45-9917-a878f514b38a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:34.584210 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0af45e0c-b29d-4d45-9917-a878f514b38a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:34.584975 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0af45e0c-b29d-4d45-9917-a878f514b38a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:34.585408 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0af45e0c-b29d-4d45-9917-a878f514b38a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:34.626308 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-77aaadb4-fb9d-40bd-bda3-898ccac9b3a2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lazy-loading 'services' on Instance uuid 0d8a1109-c502-4228-836f-6ed4a63e6555 {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:49:34.780531 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-77aaadb4-fb9d-40bd-bda3-898ccac9b3a2 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555/os-volume_attachments/d8834734-54d4-4c44-8fb6-52fabadff232" status: 202 len: 0 microversion: 2.1 time: 0.305348 Jun 20 18:49:34.781312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 199/391] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jun 20 18:49:34 2022] DELETE /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555/os-volume_attachments/d8834734-54d4-4c44-8fb6-52fabadff232 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:49:34.794208 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-95b226d6-af29-46fc-a985-40226bc7d9c0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:34.796168 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-95b226d6-af29-46fc-a985-40226bc7d9c0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:34.818980 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-95b226d6-af29-46fc-a985-40226bc7d9c0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:34.819457 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-95b226d6-af29-46fc-a985-40226bc7d9c0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:34.820971 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-95b226d6-af29-46fc-a985-40226bc7d9c0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:34.821429 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-95b226d6-af29-46fc-a985-40226bc7d9c0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:35.055229 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-95b226d6-af29-46fc-a985-40226bc7d9c0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:35.063797 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-95b226d6-af29-46fc-a985-40226bc7d9c0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1258 microversion: 2.1 time: 0.281026 Jun 20 18:49:35.064564 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 200/392] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:34 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1258 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:35.078418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1de34d0b-8475-4f45-8475-cec618f2f47d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:35.079136 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1de34d0b-8475-4f45-8475-cec618f2f47d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:35.085911 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1de34d0b-8475-4f45-8475-cec618f2f47d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:35.086363 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1de34d0b-8475-4f45-8475-cec618f2f47d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:35.087157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1de34d0b-8475-4f45-8475-cec618f2f47d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:35.087591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1de34d0b-8475-4f45-8475-cec618f2f47d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:35.149737 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0af45e0c-b29d-4d45-9917-a878f514b38a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:35.158058 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0af45e0c-b29d-4d45-9917-a878f514b38a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.584575 Jun 20 18:49:35.161119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 193/393] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:34 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:35.306303 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1de34d0b-8475-4f45-8475-cec618f2f47d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:35.318950 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1de34d0b-8475-4f45-8475-cec618f2f47d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:35.321055 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1de34d0b-8475-4f45-8475-cec618f2f47d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:35.322680 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1de34d0b-8475-4f45-8475-cec618f2f47d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.248180 Jun 20 18:49:35.330050 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 201/394] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:35 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:35.374546 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-85b4b9b3-46ed-48ef-a330-0f01f1067109 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:35.375821 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-85b4b9b3-46ed-48ef-a330-0f01f1067109 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:35.386067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-85b4b9b3-46ed-48ef-a330-0f01f1067109 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:35.386588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-85b4b9b3-46ed-48ef-a330-0f01f1067109 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:35.387464 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-85b4b9b3-46ed-48ef-a330-0f01f1067109 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:35.388348 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-85b4b9b3-46ed-48ef-a330-0f01f1067109 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:35.598882 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-85b4b9b3-46ed-48ef-a330-0f01f1067109 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:35.608286 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-85b4b9b3-46ed-48ef-a330-0f01f1067109 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.238507 Jun 20 18:49:35.618166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 194/395] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:35 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:36.081267 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0bc00df6-117b-43cb-8f9e-f47e3903282b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:36.081866 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0bc00df6-117b-43cb-8f9e-f47e3903282b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:36.088304 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0bc00df6-117b-43cb-8f9e-f47e3903282b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:36.088746 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0bc00df6-117b-43cb-8f9e-f47e3903282b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:36.089489 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0bc00df6-117b-43cb-8f9e-f47e3903282b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:36.089916 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0bc00df6-117b-43cb-8f9e-f47e3903282b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:36.177959 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5bfeaf25-8a5d-460b-81bc-22225b2c8787 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:36.178811 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5bfeaf25-8a5d-460b-81bc-22225b2c8787 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:36.185089 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5bfeaf25-8a5d-460b-81bc-22225b2c8787 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:36.185712 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5bfeaf25-8a5d-460b-81bc-22225b2c8787 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:36.186868 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5bfeaf25-8a5d-460b-81bc-22225b2c8787 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:36.187144 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5bfeaf25-8a5d-460b-81bc-22225b2c8787 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:36.226286 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0bc00df6-117b-43cb-8f9e-f47e3903282b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:36.234446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0bc00df6-117b-43cb-8f9e-f47e3903282b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1258 microversion: 2.1 time: 0.156916 Jun 20 18:49:36.235628 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 202/396] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:36 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:36.324824 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5bfeaf25-8a5d-460b-81bc-22225b2c8787 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:36.340671 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5bfeaf25-8a5d-460b-81bc-22225b2c8787 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.166446 Jun 20 18:49:36.341237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 195/397] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:36 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:36.342253 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7940ef88-01fc-400d-8661-22f8c8621a64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:36.342858 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7940ef88-01fc-400d-8661-22f8c8621a64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:36.344806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:36.350019 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7940ef88-01fc-400d-8661-22f8c8621a64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:36.350458 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7940ef88-01fc-400d-8661-22f8c8621a64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:36.351246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7940ef88-01fc-400d-8661-22f8c8621a64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:36.351673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7940ef88-01fc-400d-8661-22f8c8621a64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:36.476592 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7940ef88-01fc-400d-8661-22f8c8621a64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:36.485017 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7940ef88-01fc-400d-8661-22f8c8621a64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:36.486555 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7940ef88-01fc-400d-8661-22f8c8621a64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:36.487728 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7940ef88-01fc-400d-8661-22f8c8621a64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.149431 Jun 20 18:49:36.488281 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 203/398] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:36 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:49:36.625013 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e90d3a11-54f9-4c58-967a-513df55ea748 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:36.625522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e90d3a11-54f9-4c58-967a-513df55ea748 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:36.631921 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e90d3a11-54f9-4c58-967a-513df55ea748 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:36.632361 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e90d3a11-54f9-4c58-967a-513df55ea748 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:36.633103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e90d3a11-54f9-4c58-967a-513df55ea748 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:36.633529 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e90d3a11-54f9-4c58-967a-513df55ea748 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:36.648190 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:36.766022 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e90d3a11-54f9-4c58-967a-513df55ea748 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:36.773263 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e90d3a11-54f9-4c58-967a-513df55ea748 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.152180 Jun 20 18:49:36.774097 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 196/399] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:36 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:37.251239 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-37bd5fdd-17a0-410a-9685-54dea2dd82a5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:37.251854 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-37bd5fdd-17a0-410a-9685-54dea2dd82a5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:37.258434 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-37bd5fdd-17a0-410a-9685-54dea2dd82a5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:37.258885 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-37bd5fdd-17a0-410a-9685-54dea2dd82a5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:37.259673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-37bd5fdd-17a0-410a-9685-54dea2dd82a5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:37.260111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-37bd5fdd-17a0-410a-9685-54dea2dd82a5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:37.358133 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ccf012df-4e8a-46eb-916b-a453fef6168c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:37.358774 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ccf012df-4e8a-46eb-916b-a453fef6168c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:37.364905 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ccf012df-4e8a-46eb-916b-a453fef6168c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:37.365355 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ccf012df-4e8a-46eb-916b-a453fef6168c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:37.366120 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ccf012df-4e8a-46eb-916b-a453fef6168c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:37.366555 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ccf012df-4e8a-46eb-916b-a453fef6168c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:37.403825 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-37bd5fdd-17a0-410a-9685-54dea2dd82a5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:37.411325 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-37bd5fdd-17a0-410a-9685-54dea2dd82a5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1258 microversion: 2.1 time: 0.163978 Jun 20 18:49:37.411894 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 204/400] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:37 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:37.492585 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ccf012df-4e8a-46eb-916b-a453fef6168c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:37.500174 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ccf012df-4e8a-46eb-916b-a453fef6168c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.146487 Jun 20 18:49:37.500731 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 197/401] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:37 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:37.505811 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-13c0ff62-da9f-493a-b53a-62b77bbe8972 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:37.506408 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-13c0ff62-da9f-493a-b53a-62b77bbe8972 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:37.513883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-13c0ff62-da9f-493a-b53a-62b77bbe8972 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:37.514452 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-13c0ff62-da9f-493a-b53a-62b77bbe8972 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:37.515240 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-13c0ff62-da9f-493a-b53a-62b77bbe8972 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:37.515670 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-13c0ff62-da9f-493a-b53a-62b77bbe8972 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:37.645227 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-13c0ff62-da9f-493a-b53a-62b77bbe8972 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:37.654770 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-13c0ff62-da9f-493a-b53a-62b77bbe8972 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:37.656523 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-13c0ff62-da9f-493a-b53a-62b77bbe8972 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:37.657747 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-13c0ff62-da9f-493a-b53a-62b77bbe8972 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.155828 Jun 20 18:49:37.658399 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 205/402] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:37 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:49:37.675579 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-bd64ba4f-4eca-4d3a-ba69-dc69b43944cf req-804e2cdc-9327-42b4-9f3c-67effb3676f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a42434-2efd-4f8e-b3fb-e77f0e99f072", "name": "network-vif-plugged", "status": "completed", "tag": "96708947-b2a6-41f9-8eb6-1a4bc89a1294"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:37.684733 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-bd64ba4f-4eca-4d3a-ba69-dc69b43944cf req-804e2cdc-9327-42b4-9f3c-67effb3676f2 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:37.685613 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-bd64ba4f-4eca-4d3a-ba69-dc69b43944cf req-804e2cdc-9327-42b4-9f3c-67effb3676f2 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:37.704502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-bd64ba4f-4eca-4d3a-ba69-dc69b43944cf req-804e2cdc-9327-42b4-9f3c-67effb3676f2 service nova] Creating event network-vif-plugged:96708947-b2a6-41f9-8eb6-1a4bc89a1294 for instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 on hv-cinder-83697 Jun 20 18:49:37.709856 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-bd64ba4f-4eca-4d3a-ba69-dc69b43944cf req-804e2cdc-9327-42b4-9f3c-67effb3676f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037881 Jun 20 18:49:37.710648 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 198/403] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:49:37.789921 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e870460d-0d5e-46ac-9709-837ebb84a3f4 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:37.790532 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e870460d-0d5e-46ac-9709-837ebb84a3f4 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:37.796518 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e870460d-0d5e-46ac-9709-837ebb84a3f4 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:37.796963 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e870460d-0d5e-46ac-9709-837ebb84a3f4 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:37.797718 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e870460d-0d5e-46ac-9709-837ebb84a3f4 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:37.798145 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e870460d-0d5e-46ac-9709-837ebb84a3f4 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:37.943482 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e870460d-0d5e-46ac-9709-837ebb84a3f4 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:37.950775 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e870460d-0d5e-46ac-9709-837ebb84a3f4 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.165065 Jun 20 18:49:37.951365 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 206/404] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:37 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:38.429736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1fe904d5-65d9-4222-b650-db9d49c5bf60 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:38.430342 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1fe904d5-65d9-4222-b650-db9d49c5bf60 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:38.437103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1fe904d5-65d9-4222-b650-db9d49c5bf60 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:38.437537 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1fe904d5-65d9-4222-b650-db9d49c5bf60 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:38.438281 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1fe904d5-65d9-4222-b650-db9d49c5bf60 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:38.438706 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1fe904d5-65d9-4222-b650-db9d49c5bf60 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:38.517084 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0ea328f7-d284-4295-8ea0-82f8a9717deb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:38.517689 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0ea328f7-d284-4295-8ea0-82f8a9717deb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:38.524458 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ea328f7-d284-4295-8ea0-82f8a9717deb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:38.524907 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ea328f7-d284-4295-8ea0-82f8a9717deb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:38.525670 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ea328f7-d284-4295-8ea0-82f8a9717deb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:38.526105 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ea328f7-d284-4295-8ea0-82f8a9717deb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:38.570403 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-1fe904d5-65d9-4222-b650-db9d49c5bf60 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:38.577835 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1fe904d5-65d9-4222-b650-db9d49c5bf60 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1258 microversion: 2.1 time: 0.152358 Jun 20 18:49:38.578394 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 199/405] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:38 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:38.657914 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0ea328f7-d284-4295-8ea0-82f8a9717deb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:38.660196 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:38.667657 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0ea328f7-d284-4295-8ea0-82f8a9717deb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.154403 Jun 20 18:49:38.668251 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 207/406] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:38 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:38.676204 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-63cc0073-1f23-4427-8ae1-77ffa72113eb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:38.676835 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-63cc0073-1f23-4427-8ae1-77ffa72113eb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:38.682996 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-63cc0073-1f23-4427-8ae1-77ffa72113eb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:38.683386 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-63cc0073-1f23-4427-8ae1-77ffa72113eb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:38.684133 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-63cc0073-1f23-4427-8ae1-77ffa72113eb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:38.684617 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-63cc0073-1f23-4427-8ae1-77ffa72113eb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:38.816751 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-63cc0073-1f23-4427-8ae1-77ffa72113eb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:38.824911 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-63cc0073-1f23-4427-8ae1-77ffa72113eb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:38.826458 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-63cc0073-1f23-4427-8ae1-77ffa72113eb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:38.827641 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-63cc0073-1f23-4427-8ae1-77ffa72113eb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.155268 Jun 20 18:49:38.828187 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 200/407] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:38 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:38.968165 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-00c890e1-7111-4795-905f-f3e4164a6ee5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:38.968693 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-00c890e1-7111-4795-905f-f3e4164a6ee5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:38.975379 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-00c890e1-7111-4795-905f-f3e4164a6ee5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:38.975813 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-00c890e1-7111-4795-905f-f3e4164a6ee5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:38.976572 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-00c890e1-7111-4795-905f-f3e4164a6ee5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:38.976995 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-00c890e1-7111-4795-905f-f3e4164a6ee5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:39.105562 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-00c890e1-7111-4795-905f-f3e4164a6ee5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:39.113159 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-00c890e1-7111-4795-905f-f3e4164a6ee5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1357 microversion: 2.1 time: 0.149533 Jun 20 18:49:39.113722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 208/408] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:38 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:39.593987 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-931997c6-b48f-4910-b927-100bdd74d6a7 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:39.594510 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-931997c6-b48f-4910-b927-100bdd74d6a7 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:39.600777 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-931997c6-b48f-4910-b927-100bdd74d6a7 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:39.601221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-931997c6-b48f-4910-b927-100bdd74d6a7 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:39.601976 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-931997c6-b48f-4910-b927-100bdd74d6a7 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:39.602405 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-931997c6-b48f-4910-b927-100bdd74d6a7 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:39.684913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-44f06f4c-2424-4a38-b646-ee2c7d52e2cb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:39.685544 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-44f06f4c-2424-4a38-b646-ee2c7d52e2cb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:39.692106 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44f06f4c-2424-4a38-b646-ee2c7d52e2cb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:39.692553 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44f06f4c-2424-4a38-b646-ee2c7d52e2cb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:39.693315 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44f06f4c-2424-4a38-b646-ee2c7d52e2cb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:39.693745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44f06f4c-2424-4a38-b646-ee2c7d52e2cb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:39.739835 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-931997c6-b48f-4910-b927-100bdd74d6a7 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:39.747411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-931997c6-b48f-4910-b927-100bdd74d6a7 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1258 microversion: 2.1 time: 0.157823 Jun 20 18:49:39.747973 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 201/409] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:39 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:39.836019 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-44f06f4c-2424-4a38-b646-ee2c7d52e2cb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:39.844491 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-44f06f4c-2424-4a38-b646-ee2c7d52e2cb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.163285 Jun 20 18:49:39.845135 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 209/410] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:39 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:39.846724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7ad1448f-afde-49c5-9d42-7bd22579bf69 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:39.851108 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7ad1448f-afde-49c5-9d42-7bd22579bf69 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:39.853969 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7ad1448f-afde-49c5-9d42-7bd22579bf69 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:39.854474 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7ad1448f-afde-49c5-9d42-7bd22579bf69 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:39.855351 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7ad1448f-afde-49c5-9d42-7bd22579bf69 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:39.855776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7ad1448f-afde-49c5-9d42-7bd22579bf69 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:39.978622 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7ad1448f-afde-49c5-9d42-7bd22579bf69 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:39.986754 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7ad1448f-afde-49c5-9d42-7bd22579bf69 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:39.988309 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7ad1448f-afde-49c5-9d42-7bd22579bf69 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:39.989458 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7ad1448f-afde-49c5-9d42-7bd22579bf69 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.147151 Jun 20 18:49:39.990016 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 202/411] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:39 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:40.129391 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-704ddc28-8aca-4639-9fe7-5df1d8daa638 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:40.130002 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-704ddc28-8aca-4639-9fe7-5df1d8daa638 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:40.135996 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-704ddc28-8aca-4639-9fe7-5df1d8daa638 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:40.136445 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-704ddc28-8aca-4639-9fe7-5df1d8daa638 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:40.137206 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-704ddc28-8aca-4639-9fe7-5df1d8daa638 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:40.137660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-704ddc28-8aca-4639-9fe7-5df1d8daa638 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:40.262088 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-704ddc28-8aca-4639-9fe7-5df1d8daa638 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:40.270325 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-704ddc28-8aca-4639-9fe7-5df1d8daa638 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1547 microversion: 2.1 time: 0.144812 Jun 20 18:49:40.270881 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 210/412] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:40 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1547 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:40.287093 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f1936c05-a767-4875-a897-728692157e46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:40.288042 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f1936c05-a767-4875-a897-728692157e46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:40.293956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f1936c05-a767-4875-a897-728692157e46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:40.294402 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f1936c05-a767-4875-a897-728692157e46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:40.295186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f1936c05-a767-4875-a897-728692157e46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:40.295624 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f1936c05-a767-4875-a897-728692157e46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:40.424380 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f1936c05-a767-4875-a897-728692157e46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:40.432056 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f1936c05-a767-4875-a897-728692157e46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1547 microversion: 2.1 time: 0.149078 Jun 20 18:49:40.432616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 203/413] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:40 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:40.447873 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ef016c24-3144-4394-9f24-020a321d54ab tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:40.452093 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ef016c24-3144-4394-9f24-020a321d54ab tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:40.452846 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ef016c24-3144-4394-9f24-020a321d54ab tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Searching by: {'deleted': False, 'project_id': '4b52def37b964824993a0edb3abc3413'} {{(pid=124189) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 18:49:40.459414 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ef016c24-3144-4394-9f24-020a321d54ab tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:40.459860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ef016c24-3144-4394-9f24-020a321d54ab tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:40.460650 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ef016c24-3144-4394-9f24-020a321d54ab tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:40.461086 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ef016c24-3144-4394-9f24-020a321d54ab tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:40.549166 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.multi_cell_list [None req-ef016c24-3144-4394-9f24-020a321d54ab tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124189) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 18:49:40.640255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ef016c24-3144-4394-9f24-020a321d54ab tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.195962 Jun 20 18:49:40.640756 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 211/414] 10.222.0.43 () {58 vars in 1124 bytes} [Mon Jun 20 18:49:40 2022] GET /compute/v2.1/servers => generated 342 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:49:40.650937 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ffb5d162-f233-421b-ae52-638f81212749 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:40.651558 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ffb5d162-f233-421b-ae52-638f81212749 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:40.653638 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=72 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:40.658805 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ffb5d162-f233-421b-ae52-638f81212749 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:40.659282 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ffb5d162-f233-421b-ae52-638f81212749 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:40.660028 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ffb5d162-f233-421b-ae52-638f81212749 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:40.660455 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ffb5d162-f233-421b-ae52-638f81212749 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:40.762962 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8f0b2993-c059-47cb-b558-a7ac776dfea4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:40.763560 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8f0b2993-c059-47cb-b558-a7ac776dfea4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:40.769861 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8f0b2993-c059-47cb-b558-a7ac776dfea4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:40.770292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8f0b2993-c059-47cb-b558-a7ac776dfea4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:40.771145 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8f0b2993-c059-47cb-b558-a7ac776dfea4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:40.771573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8f0b2993-c059-47cb-b558-a7ac776dfea4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:40.786725 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ffb5d162-f233-421b-ae52-638f81212749 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:40.795146 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ffb5d162-f233-421b-ae52-638f81212749 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1547 microversion: 2.1 time: 0.147992 Jun 20 18:49:40.795798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 204/415] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:40 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:40.861265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-415980b8-311a-40f5-969e-94f4925e4369 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:40.862056 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-415980b8-311a-40f5-969e-94f4925e4369 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:40.869832 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-415980b8-311a-40f5-969e-94f4925e4369 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:40.869832 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-415980b8-311a-40f5-969e-94f4925e4369 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:40.870140 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-415980b8-311a-40f5-969e-94f4925e4369 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:40.870314 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-415980b8-311a-40f5-969e-94f4925e4369 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:40.917498 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8f0b2993-c059-47cb-b558-a7ac776dfea4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:40.929659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8f0b2993-c059-47cb-b558-a7ac776dfea4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1258 microversion: 2.1 time: 0.170439 Jun 20 18:49:40.931031 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 212/416] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:40 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:41.008006 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ed9210ff-d215-45f6-8270-1334ff7bf887 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:41.008601 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ed9210ff-d215-45f6-8270-1334ff7bf887 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:41.015204 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed9210ff-d215-45f6-8270-1334ff7bf887 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:41.015917 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed9210ff-d215-45f6-8270-1334ff7bf887 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:41.016669 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed9210ff-d215-45f6-8270-1334ff7bf887 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:41.017098 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed9210ff-d215-45f6-8270-1334ff7bf887 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:41.031063 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-415980b8-311a-40f5-969e-94f4925e4369 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:41.039825 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-415980b8-311a-40f5-969e-94f4925e4369 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.182247 Jun 20 18:49:41.040385 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 205/417] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:40 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:41.212967 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ed9210ff-d215-45f6-8270-1334ff7bf887 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:41.221708 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ed9210ff-d215-45f6-8270-1334ff7bf887 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:41.223239 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ed9210ff-d215-45f6-8270-1334ff7bf887 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:41.224385 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ed9210ff-d215-45f6-8270-1334ff7bf887 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.220351 Jun 20 18:49:41.224943 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 213/418] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:41 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:49:41.945401 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8d82496a-09f0-4b16-9804-2b2d2893cc8b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:41.946115 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8d82496a-09f0-4b16-9804-2b2d2893cc8b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:41.952712 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8d82496a-09f0-4b16-9804-2b2d2893cc8b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:41.953151 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8d82496a-09f0-4b16-9804-2b2d2893cc8b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:41.953902 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8d82496a-09f0-4b16-9804-2b2d2893cc8b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:41.954330 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8d82496a-09f0-4b16-9804-2b2d2893cc8b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:42.058667 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fdebc2c4-d713-49f3-938e-a6149a641a65 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:42.059422 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fdebc2c4-d713-49f3-938e-a6149a641a65 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:42.065838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fdebc2c4-d713-49f3-938e-a6149a641a65 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:42.066372 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fdebc2c4-d713-49f3-938e-a6149a641a65 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:42.067225 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fdebc2c4-d713-49f3-938e-a6149a641a65 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:42.067727 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fdebc2c4-d713-49f3-938e-a6149a641a65 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:42.085442 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8d82496a-09f0-4b16-9804-2b2d2893cc8b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:42.093883 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8d82496a-09f0-4b16-9804-2b2d2893cc8b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1258 microversion: 2.1 time: 0.152248 Jun 20 18:49:42.094436 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 206/419] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:41 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:42.205539 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fdebc2c4-d713-49f3-938e-a6149a641a65 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:42.212947 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fdebc2c4-d713-49f3-938e-a6149a641a65 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.158059 Jun 20 18:49:42.213511 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 214/420] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:42 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:42.243258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-53e445ff-2be9-43fc-9810-097e8d7b4745 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:42.243858 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-53e445ff-2be9-43fc-9810-097e8d7b4745 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:42.250673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-53e445ff-2be9-43fc-9810-097e8d7b4745 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:42.251148 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-53e445ff-2be9-43fc-9810-097e8d7b4745 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:42.251899 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-53e445ff-2be9-43fc-9810-097e8d7b4745 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:42.252325 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-53e445ff-2be9-43fc-9810-097e8d7b4745 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:42.332802 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-cedfd1fc-4a37-4f31-b223-2e513e7f4edc tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Action: 'create', calling method: .version_select at 0x7f7e455a75e0>, body: {"keypair": {"name": "tempest-keypair-1874364346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUHx+5jLw3JvkadtmzRKcPek6x/uq64Vf2FRouHT5zsjacWaBMbt3VzwPnaZkZdO5RWdPQ1NquZ2WZbhnwFsVRAjH+YVdeiDv0NBtB3pv/xGwVDtl4UtA1KF8SAcl4Z7w=="}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:42.347872 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-cedfd1fc-4a37-4f31-b223-2e513e7f4edc tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for project 8006d78bc1604611b3254b5efa451288. Resources: {'key_pairs'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:49:42.352107 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-cedfd1fc-4a37-4f31-b223-2e513e7f4edc tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for user c3134832f2a647aab761da347f7e9fd4 and project 8006d78bc1604611b3254b5efa451288. Resources: {'key_pairs'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:49:42.384079 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-cedfd1fc-4a37-4f31-b223-2e513e7f4edc tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055215 Jun 20 18:49:42.384800 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 215/421] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jun 20 18:49:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:49:42.406231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-53e445ff-2be9-43fc-9810-097e8d7b4745 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:42.430935 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-53e445ff-2be9-43fc-9810-097e8d7b4745 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:42.433878 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-53e445ff-2be9-43fc-9810-097e8d7b4745 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:42.438722 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-53e445ff-2be9-43fc-9810-097e8d7b4745 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.199078 Jun 20 18:49:42.440344 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 207/422] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:42 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:42.487805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-138ec1dd-d183-4987-9724-75b4839d5bea tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18749aa8-d526-4554-ada6-05949098ec7a"}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:42.488967 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-138ec1dd-d183-4987-9724-75b4839d5bea tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:42.495117 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-138ec1dd-d183-4987-9724-75b4839d5bea tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:42.495563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-138ec1dd-d183-4987-9724-75b4839d5bea tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:42.496715 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-138ec1dd-d183-4987-9724-75b4839d5bea tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:42.496715 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-138ec1dd-d183-4987-9724-75b4839d5bea tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:43.109584 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-cb234b7a-9fb8-466e-be82-6f2924880f05 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:43.110439 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-cb234b7a-9fb8-466e-be82-6f2924880f05 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:43.117144 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cb234b7a-9fb8-466e-be82-6f2924880f05 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:43.117594 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cb234b7a-9fb8-466e-be82-6f2924880f05 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:43.118358 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cb234b7a-9fb8-466e-be82-6f2924880f05 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:43.118796 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cb234b7a-9fb8-466e-be82-6f2924880f05 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:43.253002 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cb234b7a-9fb8-466e-be82-6f2924880f05 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:43.261834 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-cb234b7a-9fb8-466e-be82-6f2924880f05 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1258 microversion: 2.1 time: 0.156103 Jun 20 18:49:43.263326 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 208/423] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:43 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:43.267863 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f88559cf-8e85-41df-9ee2-85cefcff222d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:43.268474 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f88559cf-8e85-41df-9ee2-85cefcff222d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:43.274553 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f88559cf-8e85-41df-9ee2-85cefcff222d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:43.275031 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f88559cf-8e85-41df-9ee2-85cefcff222d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:43.275800 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f88559cf-8e85-41df-9ee2-85cefcff222d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:43.276239 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f88559cf-8e85-41df-9ee2-85cefcff222d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:43.408552 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f88559cf-8e85-41df-9ee2-85cefcff222d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:43.417780 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f88559cf-8e85-41df-9ee2-85cefcff222d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.153293 Jun 20 18:49:43.418289 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 209/424] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:43 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:43.458059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-88406d07-0e0a-4746-9c3a-d1e93096d7ce tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:43.460797 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-88406d07-0e0a-4746-9c3a-d1e93096d7ce tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:43.473489 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-88406d07-0e0a-4746-9c3a-d1e93096d7ce tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:43.474212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-88406d07-0e0a-4746-9c3a-d1e93096d7ce tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:43.475169 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-88406d07-0e0a-4746-9c3a-d1e93096d7ce tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:43.475774 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-88406d07-0e0a-4746-9c3a-d1e93096d7ce tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:43.626933 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-138ec1dd-d183-4987-9724-75b4839d5bea tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "POST /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.143197 Jun 20 18:49:43.627908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 216/425] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jun 20 18:49:42 2022] POST /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/os-volume_attachments => generated 194 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:49:43.654264 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-88406d07-0e0a-4746-9c3a-d1e93096d7ce tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:43.663796 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-88406d07-0e0a-4746-9c3a-d1e93096d7ce tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:43.665968 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-88406d07-0e0a-4746-9c3a-d1e93096d7ce tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:43.667194 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-88406d07-0e0a-4746-9c3a-d1e93096d7ce tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.212950 Jun 20 18:49:43.672542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 210/426] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:43 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:43.761308 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1739618448", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26505b1c-460a-483f-99b8-daa82e0cee5d"}], "security_groups": [{"name": "tempest-securitygroup--2109834904"}], "key_name": "tempest-keypair-1874364346", "user_data": "}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:43.867250 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.network.neutron [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] validate_networks() for [('26505b1c-460a-483f-99b8-daa82e0cee5d', None, None, None, None, None)] {{(pid=124189) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:49:44.226679 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Flavor limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:49:44.227135 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Image limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:49:44.227622 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Flavor pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:49:44.228020 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Image pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:49:44.228443 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:49:44.237077 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:44.237512 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:44.238296 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:44.238722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:44.255388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for project 8006d78bc1604611b3254b5efa451288. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:49:44.259220 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for user c3134832f2a647aab761da347f7e9fd4 and project 8006d78bc1604611b3254b5efa451288. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:49:44.270426 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Going to run 1 instances... {{(pid=124189) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:49:44.272752 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124189) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:49:44.278708 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6e06908f-80f5-482b-808e-f230f02e4b8e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:44.279293 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6e06908f-80f5-482b-808e-f230f02e4b8e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:44.286354 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6e06908f-80f5-482b-808e-f230f02e4b8e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:44.286749 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6e06908f-80f5-482b-808e-f230f02e4b8e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:44.287556 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6e06908f-80f5-482b-808e-f230f02e4b8e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:44.288242 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6e06908f-80f5-482b-808e-f230f02e4b8e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:44.318475 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-281aac1a-5e53-4cb1-8843-6650bad891b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.562297 Jun 20 18:49:44.319152 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 217/427] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:49:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:49:44.328810 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9846705d-77f6-40cb-8b34-18479135b4df tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:44.329418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9846705d-77f6-40cb-8b34-18479135b4df tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:44.384947 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9846705d-77f6-40cb-8b34-18479135b4df tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:44.393569 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9846705d-77f6-40cb-8b34-18479135b4df tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1242 microversion: 2.1 time: 0.068448 Jun 20 18:49:44.394144 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 218/428] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:44 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:44.439380 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c4864059-7ba3-4b4b-8c9e-c29e3e0128a5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:44.440167 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c4864059-7ba3-4b4b-8c9e-c29e3e0128a5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:44.448865 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c4864059-7ba3-4b4b-8c9e-c29e3e0128a5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:44.450637 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c4864059-7ba3-4b4b-8c9e-c29e3e0128a5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:44.451747 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c4864059-7ba3-4b4b-8c9e-c29e3e0128a5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:44.452167 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c4864059-7ba3-4b4b-8c9e-c29e3e0128a5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:44.485666 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6e06908f-80f5-482b-808e-f230f02e4b8e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:44.502438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6e06908f-80f5-482b-808e-f230f02e4b8e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1258 microversion: 2.1 time: 0.227576 Jun 20 18:49:44.505457 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 211/429] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:44 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1258 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:44.604037 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c4864059-7ba3-4b4b-8c9e-c29e3e0128a5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:44.614245 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c4864059-7ba3-4b4b-8c9e-c29e3e0128a5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.181250 Jun 20 18:49:44.615030 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 219/430] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:44 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:44.686050 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0b102750-4b90-4946-9dc0-b0871fe77fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:44.686694 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0b102750-4b90-4946-9dc0-b0871fe77fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:44.692566 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0b102750-4b90-4946-9dc0-b0871fe77fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:44.693015 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0b102750-4b90-4946-9dc0-b0871fe77fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:44.693770 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0b102750-4b90-4946-9dc0-b0871fe77fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:44.694201 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0b102750-4b90-4946-9dc0-b0871fe77fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:44.832874 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0b102750-4b90-4946-9dc0-b0871fe77fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:44.842690 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0b102750-4b90-4946-9dc0-b0871fe77fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:44.844232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0b102750-4b90-4946-9dc0-b0871fe77fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:44.845385 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0b102750-4b90-4946-9dc0-b0871fe77fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.163285 Jun 20 18:49:44.845979 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 212/431] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:44 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:45.409574 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-609e04a5-5a33-42c6-8acc-b20fa3fdfc3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:45.410187 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-609e04a5-5a33-42c6-8acc-b20fa3fdfc3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:45.416740 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-609e04a5-5a33-42c6-8acc-b20fa3fdfc3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:45.417169 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-609e04a5-5a33-42c6-8acc-b20fa3fdfc3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:45.417922 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-609e04a5-5a33-42c6-8acc-b20fa3fdfc3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:45.418356 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-609e04a5-5a33-42c6-8acc-b20fa3fdfc3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:45.481110 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-609e04a5-5a33-42c6-8acc-b20fa3fdfc3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:45.488553 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-609e04a5-5a33-42c6-8acc-b20fa3fdfc3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1294 microversion: 2.1 time: 0.082816 Jun 20 18:49:45.489117 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 220/432] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:45 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:45.520911 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c4ea2ae7-28ab-4600-a4cd-0bdae40374b4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:45.521506 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c4ea2ae7-28ab-4600-a4cd-0bdae40374b4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:45.528686 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c4ea2ae7-28ab-4600-a4cd-0bdae40374b4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:45.529345 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c4ea2ae7-28ab-4600-a4cd-0bdae40374b4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:45.530360 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c4ea2ae7-28ab-4600-a4cd-0bdae40374b4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:45.531124 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c4ea2ae7-28ab-4600-a4cd-0bdae40374b4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:45.631468 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7ba353bf-8abf-496d-9e8e-3ee7d20221da tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:45.632069 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7ba353bf-8abf-496d-9e8e-3ee7d20221da tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:45.639111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7ba353bf-8abf-496d-9e8e-3ee7d20221da tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:45.639551 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7ba353bf-8abf-496d-9e8e-3ee7d20221da tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:45.640309 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7ba353bf-8abf-496d-9e8e-3ee7d20221da tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:45.640735 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7ba353bf-8abf-496d-9e8e-3ee7d20221da tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:45.695560 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c4ea2ae7-28ab-4600-a4cd-0bdae40374b4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:45.697760 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=100 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:45.708332 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c4ea2ae7-28ab-4600-a4cd-0bdae40374b4 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1258 microversion: 2.1 time: 0.191278 Jun 20 18:49:45.718498 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 213/433] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:45 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1258 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:45.788595 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7ba353bf-8abf-496d-9e8e-3ee7d20221da tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:45.796906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7ba353bf-8abf-496d-9e8e-3ee7d20221da tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.169141 Jun 20 18:49:45.797706 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 221/434] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:45 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:45.863269 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7358c2ca-5b67-4e38-8655-651e27922066 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:45.863879 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7358c2ca-5b67-4e38-8655-651e27922066 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:45.870063 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7358c2ca-5b67-4e38-8655-651e27922066 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:45.875797 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7358c2ca-5b67-4e38-8655-651e27922066 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:45.876596 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7358c2ca-5b67-4e38-8655-651e27922066 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:45.877030 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7358c2ca-5b67-4e38-8655-651e27922066 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:46.015155 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-bd6a169b-dcdc-4cb4-a801-8328f15d8427 req-a1d3a9fa-0676-4e8b-b7b2-1dc4f834f32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85165412-e44c-453d-aa22-d248bff1a459", "name": "network-vif-plugged", "status": "completed", "tag": "12fa4b8e-1393-46da-afb1-ff594d0231e6"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:46.024442 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-bd6a169b-dcdc-4cb4-a801-8328f15d8427 req-a1d3a9fa-0676-4e8b-b7b2-1dc4f834f32f service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:46.025436 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-bd6a169b-dcdc-4cb4-a801-8328f15d8427 req-a1d3a9fa-0676-4e8b-b7b2-1dc4f834f32f service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:46.036585 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-bd6a169b-dcdc-4cb4-a801-8328f15d8427 req-a1d3a9fa-0676-4e8b-b7b2-1dc4f834f32f service nova] Creating event network-vif-plugged:12fa4b8e-1393-46da-afb1-ff594d0231e6 for instance 85165412-e44c-453d-aa22-d248bff1a459 on hv-cinder-83697 Jun 20 18:49:46.042002 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-bd6a169b-dcdc-4cb4-a801-8328f15d8427 req-a1d3a9fa-0676-4e8b-b7b2-1dc4f834f32f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030779 Jun 20 18:49:46.042871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 222/435] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:49:46.093347 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7358c2ca-5b67-4e38-8655-651e27922066 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:46.107590 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7358c2ca-5b67-4e38-8655-651e27922066 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:46.109462 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7358c2ca-5b67-4e38-8655-651e27922066 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:46.110843 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7358c2ca-5b67-4e38-8655-651e27922066 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.251636 Jun 20 18:49:46.111983 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 214/436] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:45 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:46.506222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ba49c585-4393-4c52-b983-acdfedaabbee tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:46.506944 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ba49c585-4393-4c52-b983-acdfedaabbee tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:46.514106 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ba49c585-4393-4c52-b983-acdfedaabbee tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:46.514539 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ba49c585-4393-4c52-b983-acdfedaabbee tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:46.515329 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ba49c585-4393-4c52-b983-acdfedaabbee tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:46.515758 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ba49c585-4393-4c52-b983-acdfedaabbee tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:46.656808 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ba49c585-4393-4c52-b983-acdfedaabbee tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:46.664653 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ba49c585-4393-4c52-b983-acdfedaabbee tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1368 microversion: 2.1 time: 0.162772 Jun 20 18:49:46.665301 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 223/437] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:46 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:46.725269 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2ae63f45-a5d4-4513-97f2-75af22df4f14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:46.725869 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2ae63f45-a5d4-4513-97f2-75af22df4f14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:46.732889 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2ae63f45-a5d4-4513-97f2-75af22df4f14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:46.733331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2ae63f45-a5d4-4513-97f2-75af22df4f14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:46.734082 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2ae63f45-a5d4-4513-97f2-75af22df4f14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:46.734508 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2ae63f45-a5d4-4513-97f2-75af22df4f14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:46.814113 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5156c9c7-d70f-4b4f-af26-289d2b16deae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:46.814858 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5156c9c7-d70f-4b4f-af26-289d2b16deae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:46.820830 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5156c9c7-d70f-4b4f-af26-289d2b16deae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:46.821279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5156c9c7-d70f-4b4f-af26-289d2b16deae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:46.822128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5156c9c7-d70f-4b4f-af26-289d2b16deae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:46.822508 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5156c9c7-d70f-4b4f-af26-289d2b16deae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:46.956668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2ae63f45-a5d4-4513-97f2-75af22df4f14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:46.957416 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5156c9c7-d70f-4b4f-af26-289d2b16deae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:46.964299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2ae63f45-a5d4-4513-97f2-75af22df4f14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1258 microversion: 2.1 time: 0.242940 Jun 20 18:49:46.965215 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 215/438] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:46 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1258 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:46.967542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5156c9c7-d70f-4b4f-af26-289d2b16deae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.155754 Jun 20 18:49:46.967542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 224/439] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:46 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:47.129759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a2e8ec78-3118-4d40-b2e5-12defaafca6c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:47.130263 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a2e8ec78-3118-4d40-b2e5-12defaafca6c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:47.136275 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a2e8ec78-3118-4d40-b2e5-12defaafca6c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:47.136713 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a2e8ec78-3118-4d40-b2e5-12defaafca6c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:47.138029 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a2e8ec78-3118-4d40-b2e5-12defaafca6c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:47.138454 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a2e8ec78-3118-4d40-b2e5-12defaafca6c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:47.285979 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a2e8ec78-3118-4d40-b2e5-12defaafca6c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:47.295380 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a2e8ec78-3118-4d40-b2e5-12defaafca6c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:47.297304 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a2e8ec78-3118-4d40-b2e5-12defaafca6c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:47.298832 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a2e8ec78-3118-4d40-b2e5-12defaafca6c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.173057 Jun 20 18:49:47.299912 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 225/440] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:47 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:47.441506 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-58bd48dc-06fb-46b1-af85-642a04ed5a0f req-45e21af6-69b1-4e4e-8049-6e0cc2e249a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6efd07f2-b56d-4cc1-8187-d6d3afca2c86", "tag": "28f8401e-b1a6-48d5-8f19-cf2b25578a52"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:47.450637 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-58bd48dc-06fb-46b1-af85-642a04ed5a0f req-45e21af6-69b1-4e4e-8049-6e0cc2e249a5 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:47.455544 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-58bd48dc-06fb-46b1-af85-642a04ed5a0f req-45e21af6-69b1-4e4e-8049-6e0cc2e249a5 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:47.467729 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-58bd48dc-06fb-46b1-af85-642a04ed5a0f req-45e21af6-69b1-4e4e-8049-6e0cc2e249a5 service nova] Creating event network-changed:28f8401e-b1a6-48d5-8f19-cf2b25578a52 for instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 on hv-cinder-83697 Jun 20 18:49:47.473070 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-58bd48dc-06fb-46b1-af85-642a04ed5a0f req-45e21af6-69b1-4e4e-8049-6e0cc2e249a5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037114 Jun 20 18:49:47.473806 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 216/441] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:49:47.681310 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-959dc150-4737-4ef9-88e4-f53196202dce tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:47.681915 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-959dc150-4737-4ef9-88e4-f53196202dce tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:47.688857 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-959dc150-4737-4ef9-88e4-f53196202dce tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:47.689306 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-959dc150-4737-4ef9-88e4-f53196202dce tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:47.690298 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-959dc150-4737-4ef9-88e4-f53196202dce tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:47.690728 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-959dc150-4737-4ef9-88e4-f53196202dce tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:47.693462 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:47.834218 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-959dc150-4737-4ef9-88e4-f53196202dce tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:47.842441 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-959dc150-4737-4ef9-88e4-f53196202dce tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1368 microversion: 2.1 time: 0.164797 Jun 20 18:49:47.843090 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 226/442] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:47 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:47.981912 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2da8c3b9-b3e4-4cff-b5c3-1ae2ec460f1b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:47.982612 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2da8c3b9-b3e4-4cff-b5c3-1ae2ec460f1b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:47.982724 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0d63913f-60d8-425d-88b3-7b3e3b910e4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:47.983328 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0d63913f-60d8-425d-88b3-7b3e3b910e4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:47.989304 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2da8c3b9-b3e4-4cff-b5c3-1ae2ec460f1b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:47.989573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0d63913f-60d8-425d-88b3-7b3e3b910e4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:47.989753 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2da8c3b9-b3e4-4cff-b5c3-1ae2ec460f1b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:47.990011 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0d63913f-60d8-425d-88b3-7b3e3b910e4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:47.990512 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2da8c3b9-b3e4-4cff-b5c3-1ae2ec460f1b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:47.990761 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0d63913f-60d8-425d-88b3-7b3e3b910e4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:47.990973 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2da8c3b9-b3e4-4cff-b5c3-1ae2ec460f1b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:47.991215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0d63913f-60d8-425d-88b3-7b3e3b910e4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:48.119221 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0d63913f-60d8-425d-88b3-7b3e3b910e4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:48.120916 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2da8c3b9-b3e4-4cff-b5c3-1ae2ec460f1b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:48.127023 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0d63913f-60d8-425d-88b3-7b3e3b910e4a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.147996 Jun 20 18:49:48.127585 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 227/443] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:47 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:48.128371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2da8c3b9-b3e4-4cff-b5c3-1ae2ec460f1b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1258 microversion: 2.1 time: 0.150599 Jun 20 18:49:48.128920 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 217/444] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:47 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:48.317682 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6cf527bf-a9de-4744-99fe-23b449ee8f37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:48.318286 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6cf527bf-a9de-4744-99fe-23b449ee8f37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:48.324307 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6cf527bf-a9de-4744-99fe-23b449ee8f37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:48.325260 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6cf527bf-a9de-4744-99fe-23b449ee8f37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:48.326017 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6cf527bf-a9de-4744-99fe-23b449ee8f37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:48.326447 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6cf527bf-a9de-4744-99fe-23b449ee8f37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:48.459282 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6cf527bf-a9de-4744-99fe-23b449ee8f37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:48.467174 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6cf527bf-a9de-4744-99fe-23b449ee8f37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:48.468675 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6cf527bf-a9de-4744-99fe-23b449ee8f37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:48.469811 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6cf527bf-a9de-4744-99fe-23b449ee8f37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.155991 Jun 20 18:49:48.470358 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 228/445] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:48 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:48.859485 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-699fb259-5363-4da8-ac0f-ce7256ec4d61 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:48.860128 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-699fb259-5363-4da8-ac0f-ce7256ec4d61 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:48.866123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-699fb259-5363-4da8-ac0f-ce7256ec4d61 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:48.866570 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-699fb259-5363-4da8-ac0f-ce7256ec4d61 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:48.867348 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-699fb259-5363-4da8-ac0f-ce7256ec4d61 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:48.867784 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-699fb259-5363-4da8-ac0f-ce7256ec4d61 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:48.994768 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-699fb259-5363-4da8-ac0f-ce7256ec4d61 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:49.002931 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-699fb259-5363-4da8-ac0f-ce7256ec4d61 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1368 microversion: 2.1 time: 0.147779 Jun 20 18:49:49.003497 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 218/446] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:48 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:49.143741 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-13cd7c2a-509b-4d89-9004-37a93bb23405 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:49.144272 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b73f7336-ffe7-46b0-9e75-a55ea1493779 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:49.144389 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-13cd7c2a-509b-4d89-9004-37a93bb23405 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:49.144714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b73f7336-ffe7-46b0-9e75-a55ea1493779 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:49.150635 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b73f7336-ffe7-46b0-9e75-a55ea1493779 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:49.150764 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-13cd7c2a-509b-4d89-9004-37a93bb23405 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:49.151111 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b73f7336-ffe7-46b0-9e75-a55ea1493779 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:49.151224 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-13cd7c2a-509b-4d89-9004-37a93bb23405 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:49.151858 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b73f7336-ffe7-46b0-9e75-a55ea1493779 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:49.151955 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-13cd7c2a-509b-4d89-9004-37a93bb23405 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:49.152287 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b73f7336-ffe7-46b0-9e75-a55ea1493779 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:49.152396 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-13cd7c2a-509b-4d89-9004-37a93bb23405 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:49.289811 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-13cd7c2a-509b-4d89-9004-37a93bb23405 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:49.298302 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-13cd7c2a-509b-4d89-9004-37a93bb23405 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.158346 Jun 20 18:49:49.299060 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 229/447] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:49 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:49.361810 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b73f7336-ffe7-46b0-9e75-a55ea1493779 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:49.369270 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b73f7336-ffe7-46b0-9e75-a55ea1493779 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1441 microversion: 2.1 time: 0.228775 Jun 20 18:49:49.369840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 219/448] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:49 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1441 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:49.385384 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-2390e82c-7213-419e-93f6-a0a6366b4319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:49.385986 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-2390e82c-7213-419e-93f6-a0a6366b4319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:49.392203 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2390e82c-7213-419e-93f6-a0a6366b4319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:49.392641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2390e82c-7213-419e-93f6-a0a6366b4319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:49.393382 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2390e82c-7213-419e-93f6-a0a6366b4319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:49.393808 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2390e82c-7213-419e-93f6-a0a6366b4319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:49.488196 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5612968a-d59d-4952-b9e7-67f33bac31ae tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:49.488930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5612968a-d59d-4952-b9e7-67f33bac31ae tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:49.494964 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5612968a-d59d-4952-b9e7-67f33bac31ae tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:49.495490 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5612968a-d59d-4952-b9e7-67f33bac31ae tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:49.496253 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5612968a-d59d-4952-b9e7-67f33bac31ae tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:49.496683 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5612968a-d59d-4952-b9e7-67f33bac31ae tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:49.527556 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-2390e82c-7213-419e-93f6-a0a6366b4319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:49.535820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-2390e82c-7213-419e-93f6-a0a6366b4319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1441 microversion: 2.1 time: 0.154133 Jun 20 18:49:49.536389 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 230/449] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:49 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1441 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:49.628135 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5612968a-d59d-4952-b9e7-67f33bac31ae tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:49.635985 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5612968a-d59d-4952-b9e7-67f33bac31ae tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:49.637476 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5612968a-d59d-4952-b9e7-67f33bac31ae tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:49.638625 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5612968a-d59d-4952-b9e7-67f33bac31ae tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.154350 Jun 20 18:49:49.639209 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 220/450] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:49 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:50.020856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-39d4f2dd-b8a2-491e-a122-7c078737e5ea tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:50.021674 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-39d4f2dd-b8a2-491e-a122-7c078737e5ea tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:50.029339 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-39d4f2dd-b8a2-491e-a122-7c078737e5ea tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:50.029945 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-39d4f2dd-b8a2-491e-a122-7c078737e5ea tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:50.030775 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-39d4f2dd-b8a2-491e-a122-7c078737e5ea tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:50.031297 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-39d4f2dd-b8a2-491e-a122-7c078737e5ea tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:50.212130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-39d4f2dd-b8a2-491e-a122-7c078737e5ea tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:50.220227 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-39d4f2dd-b8a2-491e-a122-7c078737e5ea tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1368 microversion: 2.1 time: 0.204731 Jun 20 18:49:50.220786 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 231/451] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:50 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:50.315214 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ac0565ce-9bd5-47be-82b2-44b4c761c7c5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:50.315829 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ac0565ce-9bd5-47be-82b2-44b4c761c7c5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:50.322228 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ac0565ce-9bd5-47be-82b2-44b4c761c7c5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:50.322673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ac0565ce-9bd5-47be-82b2-44b4c761c7c5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:50.323466 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ac0565ce-9bd5-47be-82b2-44b4c761c7c5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:50.323895 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ac0565ce-9bd5-47be-82b2-44b4c761c7c5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:50.456077 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ac0565ce-9bd5-47be-82b2-44b4c761c7c5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:50.463606 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ac0565ce-9bd5-47be-82b2-44b4c761c7c5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.152305 Jun 20 18:49:50.464365 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 221/452] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:50 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:50.656792 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b79406c4-0380-4efa-a43d-f3c93593edee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:50.657389 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b79406c4-0380-4efa-a43d-f3c93593edee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:50.663718 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b79406c4-0380-4efa-a43d-f3c93593edee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:50.664200 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b79406c4-0380-4efa-a43d-f3c93593edee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:50.664952 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b79406c4-0380-4efa-a43d-f3c93593edee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:50.665385 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b79406c4-0380-4efa-a43d-f3c93593edee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:51.081720 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b79406c4-0380-4efa-a43d-f3c93593edee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:51.091452 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b79406c4-0380-4efa-a43d-f3c93593edee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:51.093395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b79406c4-0380-4efa-a43d-f3c93593edee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:51.094905 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b79406c4-0380-4efa-a43d-f3c93593edee tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.441972 Jun 20 18:49:51.095874 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 232/453] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:50 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:51.237631 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d686b524-5e4c-4b1d-bc03-28bc41da676e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:51.238239 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d686b524-5e4c-4b1d-bc03-28bc41da676e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:51.244322 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d686b524-5e4c-4b1d-bc03-28bc41da676e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:51.244814 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d686b524-5e4c-4b1d-bc03-28bc41da676e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:51.245526 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d686b524-5e4c-4b1d-bc03-28bc41da676e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:51.245958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d686b524-5e4c-4b1d-bc03-28bc41da676e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:51.374930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d686b524-5e4c-4b1d-bc03-28bc41da676e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:51.382305 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d686b524-5e4c-4b1d-bc03-28bc41da676e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1368 microversion: 2.1 time: 0.148486 Jun 20 18:49:51.382862 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 222/454] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:51 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:51.481298 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8824608a-6761-4c41-a72b-17b71c264cf2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:51.481997 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8824608a-6761-4c41-a72b-17b71c264cf2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:51.488266 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8824608a-6761-4c41-a72b-17b71c264cf2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:51.488820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8824608a-6761-4c41-a72b-17b71c264cf2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:51.489648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8824608a-6761-4c41-a72b-17b71c264cf2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:51.490149 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8824608a-6761-4c41-a72b-17b71c264cf2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:51.714692 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8824608a-6761-4c41-a72b-17b71c264cf2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:51.722861 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8824608a-6761-4c41-a72b-17b71c264cf2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.245231 Jun 20 18:49:51.723775 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 233/455] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:51 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:51.743972 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-0c93e091-b9c6-486f-b554-33e8d500bccc req-c3fb1534-781e-4197-875e-9ccba5016997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85165412-e44c-453d-aa22-d248bff1a459", "tag": "12fa4b8e-1393-46da-afb1-ff594d0231e6"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:51.752583 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-0c93e091-b9c6-486f-b554-33e8d500bccc req-c3fb1534-781e-4197-875e-9ccba5016997 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:51.753027 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-0c93e091-b9c6-486f-b554-33e8d500bccc req-c3fb1534-781e-4197-875e-9ccba5016997 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:51.764675 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-0c93e091-b9c6-486f-b554-33e8d500bccc req-c3fb1534-781e-4197-875e-9ccba5016997 service nova] Creating event network-changed:12fa4b8e-1393-46da-afb1-ff594d0231e6 for instance 85165412-e44c-453d-aa22-d248bff1a459 on hv-cinder-83697 Jun 20 18:49:51.769450 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-0c93e091-b9c6-486f-b554-33e8d500bccc req-c3fb1534-781e-4197-875e-9ccba5016997 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029169 Jun 20 18:49:51.770025 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 223/456] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:49:52.115996 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-455cf3b1-d2d5-4e54-8310-d724639557f8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:52.116527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-455cf3b1-d2d5-4e54-8310-d724639557f8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:52.123430 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-455cf3b1-d2d5-4e54-8310-d724639557f8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:52.123874 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-455cf3b1-d2d5-4e54-8310-d724639557f8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:52.124641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-455cf3b1-d2d5-4e54-8310-d724639557f8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:52.125067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-455cf3b1-d2d5-4e54-8310-d724639557f8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:52.255321 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-455cf3b1-d2d5-4e54-8310-d724639557f8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:52.263355 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-455cf3b1-d2d5-4e54-8310-d724639557f8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:52.264842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-455cf3b1-d2d5-4e54-8310-d724639557f8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:52.265983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-455cf3b1-d2d5-4e54-8310-d724639557f8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.154106 Jun 20 18:49:52.266532 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 234/457] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:52 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:52.400251 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9e71dea7-d1f3-4e19-86b9-a0dd0d432a40 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:52.401154 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9e71dea7-d1f3-4e19-86b9-a0dd0d432a40 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:52.407814 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9e71dea7-d1f3-4e19-86b9-a0dd0d432a40 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:52.408256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9e71dea7-d1f3-4e19-86b9-a0dd0d432a40 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:52.409036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9e71dea7-d1f3-4e19-86b9-a0dd0d432a40 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:52.409466 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9e71dea7-d1f3-4e19-86b9-a0dd0d432a40 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:52.601619 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9e71dea7-d1f3-4e19-86b9-a0dd0d432a40 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:52.609580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9e71dea7-d1f3-4e19-86b9-a0dd0d432a40 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1368 microversion: 2.1 time: 0.214015 Jun 20 18:49:52.610139 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 224/458] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:52 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:52.740254 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3024637c-a573-48fa-b51d-9d0a7ebe7af1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:52.740857 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-3024637c-a573-48fa-b51d-9d0a7ebe7af1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:52.748815 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3024637c-a573-48fa-b51d-9d0a7ebe7af1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:52.749255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3024637c-a573-48fa-b51d-9d0a7ebe7af1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:52.750017 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3024637c-a573-48fa-b51d-9d0a7ebe7af1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:52.750443 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3024637c-a573-48fa-b51d-9d0a7ebe7af1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:52.886315 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-3024637c-a573-48fa-b51d-9d0a7ebe7af1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:52.894709 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-3024637c-a573-48fa-b51d-9d0a7ebe7af1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.158554 Jun 20 18:49:52.895334 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 235/459] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:52 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:53.286049 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0fdc6859-ac3c-4c0c-af21-cac91a3abe18 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:53.287508 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0fdc6859-ac3c-4c0c-af21-cac91a3abe18 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:53.295880 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0fdc6859-ac3c-4c0c-af21-cac91a3abe18 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:53.296697 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0fdc6859-ac3c-4c0c-af21-cac91a3abe18 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:53.297723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0fdc6859-ac3c-4c0c-af21-cac91a3abe18 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:53.298394 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0fdc6859-ac3c-4c0c-af21-cac91a3abe18 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:53.587149 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0fdc6859-ac3c-4c0c-af21-cac91a3abe18 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:53.598813 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0fdc6859-ac3c-4c0c-af21-cac91a3abe18 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:53.600413 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0fdc6859-ac3c-4c0c-af21-cac91a3abe18 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:53.602277 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0fdc6859-ac3c-4c0c-af21-cac91a3abe18 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.321821 Jun 20 18:49:53.603262 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 225/460] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:53 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:53.627200 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b7eba13b-ab01-41f9-b516-6958ac939550 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:53.628018 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b7eba13b-ab01-41f9-b516-6958ac939550 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:53.635594 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b7eba13b-ab01-41f9-b516-6958ac939550 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:53.636364 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b7eba13b-ab01-41f9-b516-6958ac939550 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:53.637384 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b7eba13b-ab01-41f9-b516-6958ac939550 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:53.638020 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b7eba13b-ab01-41f9-b516-6958ac939550 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:53.668286 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-53b7875e-e324-460e-9d86-69187a358aa9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:53.675483 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-53b7875e-e324-460e-9d86-69187a358aa9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:53.675940 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-53b7875e-e324-460e-9d86-69187a358aa9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:53.739951 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-53b7875e-e324-460e-9d86-69187a358aa9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Going to try to stop instance {{(pid=124190) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 18:49:53.786064 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-53b7875e-e324-460e-9d86-69187a358aa9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "POST /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/action" status: 202 len: 0 microversion: 2.1 time: 0.121359 Jun 20 18:49:53.786688 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 226/461] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jun 20 18:49:53 2022] POST /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:49:53.795176 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ad249698-997f-4bdf-8667-676c520b1d18 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:53.795468 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b7eba13b-ab01-41f9-b516-6958ac939550 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:53.795988 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ad249698-997f-4bdf-8667-676c520b1d18 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:53.803119 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b7eba13b-ab01-41f9-b516-6958ac939550 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1368 microversion: 2.1 time: 0.181264 Jun 20 18:49:53.803683 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 236/462] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:53 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:53.808455 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ad249698-997f-4bdf-8667-676c520b1d18 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:53.809553 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ad249698-997f-4bdf-8667-676c520b1d18 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:53.810326 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ad249698-997f-4bdf-8667-676c520b1d18 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:53.810761 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ad249698-997f-4bdf-8667-676c520b1d18 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:53.911791 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-70862d2c-900c-47f7-9c69-98fd7107c518 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:53.912399 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-70862d2c-900c-47f7-9c69-98fd7107c518 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:53.919682 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-70862d2c-900c-47f7-9c69-98fd7107c518 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:53.920128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-70862d2c-900c-47f7-9c69-98fd7107c518 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:53.921081 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-70862d2c-900c-47f7-9c69-98fd7107c518 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:53.921681 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-70862d2c-900c-47f7-9c69-98fd7107c518 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:53.944087 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ad249698-997f-4bdf-8667-676c520b1d18 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:53.952967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ad249698-997f-4bdf-8667-676c520b1d18 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.161659 Jun 20 18:49:53.953723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 227/463] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:53 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:54.022047 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1fe6096b-283d-41d2-8b38-90472faf14aa tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:54.022672 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1fe6096b-283d-41d2-8b38-90472faf14aa tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:54.030470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1fe6096b-283d-41d2-8b38-90472faf14aa tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:54.031469 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1fe6096b-283d-41d2-8b38-90472faf14aa tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:54.033152 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1fe6096b-283d-41d2-8b38-90472faf14aa tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:54.033663 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1fe6096b-283d-41d2-8b38-90472faf14aa tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:54.057062 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-70862d2c-900c-47f7-9c69-98fd7107c518 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:54.064232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1fe6096b-283d-41d2-8b38-90472faf14aa tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:49:54.065116 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-70862d2c-900c-47f7-9c69-98fd7107c518 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.157545 Jun 20 18:49:54.065854 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 237/464] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:53 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:54.148242 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1fe6096b-283d-41d2-8b38-90472faf14aa tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 204 len: 0 microversion: 2.1 time: 0.129956 Jun 20 18:49:54.148812 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 228/465] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:49:54 2022] DELETE /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:49:54.157037 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-947bb82b-a42f-4ca0-8c84-6d40800856f9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:54.157637 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-947bb82b-a42f-4ca0-8c84-6d40800856f9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:54.163726 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-947bb82b-a42f-4ca0-8c84-6d40800856f9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:54.164162 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-947bb82b-a42f-4ca0-8c84-6d40800856f9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:54.164905 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-947bb82b-a42f-4ca0-8c84-6d40800856f9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:54.165325 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-947bb82b-a42f-4ca0-8c84-6d40800856f9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:54.248042 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=4 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:54.293945 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-947bb82b-a42f-4ca0-8c84-6d40800856f9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:54.301827 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-947bb82b-a42f-4ca0-8c84-6d40800856f9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1558 microversion: 2.1 time: 0.148897 Jun 20 18:49:54.302378 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 238/466] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:54 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:54.621381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-66c63adf-36ab-4a46-b27c-96bd25890626 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:54.622754 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-66c63adf-36ab-4a46-b27c-96bd25890626 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:54.629134 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-66c63adf-36ab-4a46-b27c-96bd25890626 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:54.629650 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-66c63adf-36ab-4a46-b27c-96bd25890626 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:54.630415 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-66c63adf-36ab-4a46-b27c-96bd25890626 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:54.630843 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-66c63adf-36ab-4a46-b27c-96bd25890626 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:54.646151 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:54.764502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-66c63adf-36ab-4a46-b27c-96bd25890626 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:54.772469 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-66c63adf-36ab-4a46-b27c-96bd25890626 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:54.773974 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-66c63adf-36ab-4a46-b27c-96bd25890626 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:54.775155 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-66c63adf-36ab-4a46-b27c-96bd25890626 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.158264 Jun 20 18:49:54.775704 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 229/467] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:54 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:54.820356 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-11689b67-a5db-49e8-9500-1345f92035b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:54.820986 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-11689b67-a5db-49e8-9500-1345f92035b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:54.822791 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=12 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:54.824005 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:54.829951 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-11689b67-a5db-49e8-9500-1345f92035b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:54.830394 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-11689b67-a5db-49e8-9500-1345f92035b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:54.831176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-11689b67-a5db-49e8-9500-1345f92035b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:54.831611 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-11689b67-a5db-49e8-9500-1345f92035b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:54.962623 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-11689b67-a5db-49e8-9500-1345f92035b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:54.969549 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-81a9f0de-4965-40ee-a1c2-0f611e496e35 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:54.970085 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-11689b67-a5db-49e8-9500-1345f92035b7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1368 microversion: 2.1 time: 0.153537 Jun 20 18:49:54.970209 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-81a9f0de-4965-40ee-a1c2-0f611e496e35 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:54.970648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 239/468] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:54 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:54.976081 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-81a9f0de-4965-40ee-a1c2-0f611e496e35 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:54.976522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-81a9f0de-4965-40ee-a1c2-0f611e496e35 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:54.977276 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-81a9f0de-4965-40ee-a1c2-0f611e496e35 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:54.977705 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-81a9f0de-4965-40ee-a1c2-0f611e496e35 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:55.081521 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9b222cbd-3fb5-422a-8518-97282c217265 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:55.082124 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9b222cbd-3fb5-422a-8518-97282c217265 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:55.088258 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9b222cbd-3fb5-422a-8518-97282c217265 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:55.088705 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9b222cbd-3fb5-422a-8518-97282c217265 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:55.089459 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9b222cbd-3fb5-422a-8518-97282c217265 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:55.089895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9b222cbd-3fb5-422a-8518-97282c217265 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:55.107852 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-81a9f0de-4965-40ee-a1c2-0f611e496e35 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:55.115593 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-81a9f0de-4965-40ee-a1c2-0f611e496e35 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.149777 Jun 20 18:49:55.116153 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 230/469] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:54 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:55.217727 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9b222cbd-3fb5-422a-8518-97282c217265 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:55.225071 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9b222cbd-3fb5-422a-8518-97282c217265 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.147468 Jun 20 18:49:55.225625 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 240/470] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:55 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:55.319353 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-35beb7ff-2b14-46fe-921e-fe1a224806e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:55.319961 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-35beb7ff-2b14-46fe-921e-fe1a224806e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:55.326111 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35beb7ff-2b14-46fe-921e-fe1a224806e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:55.326564 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35beb7ff-2b14-46fe-921e-fe1a224806e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:55.327347 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35beb7ff-2b14-46fe-921e-fe1a224806e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:55.327778 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35beb7ff-2b14-46fe-921e-fe1a224806e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:55.468345 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-35beb7ff-2b14-46fe-921e-fe1a224806e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:55.479760 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-35beb7ff-2b14-46fe-921e-fe1a224806e1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1558 microversion: 2.1 time: 0.164180 Jun 20 18:49:55.480328 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 231/471] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:55 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:55.794144 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c1c8f56c-5428-491e-ab28-f3b4ee65febb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:55.794748 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c1c8f56c-5428-491e-ab28-f3b4ee65febb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:55.800738 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c1c8f56c-5428-491e-ab28-f3b4ee65febb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:55.801186 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c1c8f56c-5428-491e-ab28-f3b4ee65febb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:55.801940 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c1c8f56c-5428-491e-ab28-f3b4ee65febb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:55.802371 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c1c8f56c-5428-491e-ab28-f3b4ee65febb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:55.928652 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c1c8f56c-5428-491e-ab28-f3b4ee65febb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:55.936806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c1c8f56c-5428-491e-ab28-f3b4ee65febb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:55.938471 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c1c8f56c-5428-491e-ab28-f3b4ee65febb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:55.939561 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c1c8f56c-5428-491e-ab28-f3b4ee65febb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.149768 Jun 20 18:49:55.940115 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 241/472] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:55 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:55.987570 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-244d14ff-2bf4-4edd-98f3-bddf617b1269 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:55.988254 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-244d14ff-2bf4-4edd-98f3-bddf617b1269 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:55.995974 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-244d14ff-2bf4-4edd-98f3-bddf617b1269 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:55.996454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-244d14ff-2bf4-4edd-98f3-bddf617b1269 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:55.997228 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-244d14ff-2bf4-4edd-98f3-bddf617b1269 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:55.997664 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-244d14ff-2bf4-4edd-98f3-bddf617b1269 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:56.094144 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-c628580d-a7cc-4649-aa35-c0da3ac6a5c6 req-5fe203ec-f1c5-4b38-9261-60c437e5a9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6efd07f2-b56d-4cc1-8187-d6d3afca2c86", "name": "network-vif-plugged", "status": "completed", "tag": "28f8401e-b1a6-48d5-8f19-cf2b25578a52"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:49:56.103131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-c628580d-a7cc-4649-aa35-c0da3ac6a5c6 req-5fe203ec-f1c5-4b38-9261-60c437e5a9f7 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:56.103676 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-c628580d-a7cc-4649-aa35-c0da3ac6a5c6 req-5fe203ec-f1c5-4b38-9261-60c437e5a9f7 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:56.115873 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-c628580d-a7cc-4649-aa35-c0da3ac6a5c6 req-5fe203ec-f1c5-4b38-9261-60c437e5a9f7 service nova] Creating event network-vif-plugged:28f8401e-b1a6-48d5-8f19-cf2b25578a52 for instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 on hv-cinder-83697 Jun 20 18:49:56.122414 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-c628580d-a7cc-4649-aa35-c0da3ac6a5c6 req-5fe203ec-f1c5-4b38-9261-60c437e5a9f7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040325 Jun 20 18:49:56.123462 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 242/473] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:49:56.133953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b2f2e145-c6df-41a1-b54c-3783a5c21f81 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:56.135075 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b2f2e145-c6df-41a1-b54c-3783a5c21f81 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:56.141884 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b2f2e145-c6df-41a1-b54c-3783a5c21f81 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:56.142334 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b2f2e145-c6df-41a1-b54c-3783a5c21f81 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:56.143300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b2f2e145-c6df-41a1-b54c-3783a5c21f81 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:56.143740 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b2f2e145-c6df-41a1-b54c-3783a5c21f81 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:56.155630 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-244d14ff-2bf4-4edd-98f3-bddf617b1269 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:56.161727 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:56.163607 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-244d14ff-2bf4-4edd-98f3-bddf617b1269 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1368 microversion: 2.1 time: 0.180134 Jun 20 18:49:56.173611 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 232/474] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:55 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:56.242063 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e7b92e51-d441-4954-87cc-8ba4818581b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:56.242666 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e7b92e51-d441-4954-87cc-8ba4818581b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:56.249283 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e7b92e51-d441-4954-87cc-8ba4818581b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:56.249728 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e7b92e51-d441-4954-87cc-8ba4818581b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:56.250490 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e7b92e51-d441-4954-87cc-8ba4818581b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:56.250941 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e7b92e51-d441-4954-87cc-8ba4818581b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:56.285201 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b2f2e145-c6df-41a1-b54c-3783a5c21f81 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:56.294317 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b2f2e145-c6df-41a1-b54c-3783a5c21f81 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.164396 Jun 20 18:49:56.294892 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 243/475] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:56 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:56.379777 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e7b92e51-d441-4954-87cc-8ba4818581b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:56.387400 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e7b92e51-d441-4954-87cc-8ba4818581b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.149010 Jun 20 18:49:56.387940 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 233/476] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:56 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:56.497368 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-2d037ead-9842-4b68-a8d9-460061776974 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:56.497918 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-2d037ead-9842-4b68-a8d9-460061776974 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:56.503959 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2d037ead-9842-4b68-a8d9-460061776974 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:56.504425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2d037ead-9842-4b68-a8d9-460061776974 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:56.505179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2d037ead-9842-4b68-a8d9-460061776974 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:56.505605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2d037ead-9842-4b68-a8d9-460061776974 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:56.631359 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-2d037ead-9842-4b68-a8d9-460061776974 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:56.638824 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-2d037ead-9842-4b68-a8d9-460061776974 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1512 microversion: 2.1 time: 0.146004 Jun 20 18:49:56.639416 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 244/477] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:56 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:56.957463 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2cf65890-ad07-42db-814e-d13801aea558 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:56.957967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2cf65890-ad07-42db-814e-d13801aea558 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:56.963930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2cf65890-ad07-42db-814e-d13801aea558 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:56.964367 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2cf65890-ad07-42db-814e-d13801aea558 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:56.965614 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2cf65890-ad07-42db-814e-d13801aea558 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:56.966065 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2cf65890-ad07-42db-814e-d13801aea558 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:57.094755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2cf65890-ad07-42db-814e-d13801aea558 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:57.102480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2cf65890-ad07-42db-814e-d13801aea558 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:57.103988 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2cf65890-ad07-42db-814e-d13801aea558 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:57.105125 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2cf65890-ad07-42db-814e-d13801aea558 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.151776 Jun 20 18:49:57.105666 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 234/478] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:56 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:57.180232 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-dd177a05-14a3-4327-a7f1-02e1c0348610 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:57.180825 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-dd177a05-14a3-4327-a7f1-02e1c0348610 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:57.187311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-dd177a05-14a3-4327-a7f1-02e1c0348610 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:57.187756 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-dd177a05-14a3-4327-a7f1-02e1c0348610 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:57.188513 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-dd177a05-14a3-4327-a7f1-02e1c0348610 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:57.188945 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-dd177a05-14a3-4327-a7f1-02e1c0348610 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:57.311214 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-823b3228-39c8-4a06-b90e-68c3455c3639 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:57.311816 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-823b3228-39c8-4a06-b90e-68c3455c3639 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:57.317746 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-823b3228-39c8-4a06-b90e-68c3455c3639 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:57.318190 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-823b3228-39c8-4a06-b90e-68c3455c3639 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:57.318363 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-dd177a05-14a3-4327-a7f1-02e1c0348610 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:57.318963 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-823b3228-39c8-4a06-b90e-68c3455c3639 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:57.319394 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-823b3228-39c8-4a06-b90e-68c3455c3639 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:57.326421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-dd177a05-14a3-4327-a7f1-02e1c0348610 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1368 microversion: 2.1 time: 0.149969 Jun 20 18:49:57.327001 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 245/479] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:57 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:57.404540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-12223a81-9c22-4bab-93aa-7958a8c0fee7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:57.405335 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-12223a81-9c22-4bab-93aa-7958a8c0fee7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:57.413030 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-12223a81-9c22-4bab-93aa-7958a8c0fee7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:57.413862 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-12223a81-9c22-4bab-93aa-7958a8c0fee7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:57.414722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-12223a81-9c22-4bab-93aa-7958a8c0fee7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:57.415423 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-12223a81-9c22-4bab-93aa-7958a8c0fee7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:57.447036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-823b3228-39c8-4a06-b90e-68c3455c3639 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:57.455678 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-823b3228-39c8-4a06-b90e-68c3455c3639 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.148318 Jun 20 18:49:57.456245 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 235/480] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:57 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:57.549354 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-12223a81-9c22-4bab-93aa-7958a8c0fee7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:57.557187 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-12223a81-9c22-4bab-93aa-7958a8c0fee7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.157176 Jun 20 18:49:57.557751 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 246/481] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:57 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:57.655682 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-df250e33-c97d-4a24-a70e-09380905fed8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:57.656282 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-df250e33-c97d-4a24-a70e-09380905fed8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:57.662188 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-df250e33-c97d-4a24-a70e-09380905fed8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:57.662628 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-df250e33-c97d-4a24-a70e-09380905fed8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:57.663644 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-df250e33-c97d-4a24-a70e-09380905fed8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:57.664073 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-df250e33-c97d-4a24-a70e-09380905fed8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:57.861757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-df250e33-c97d-4a24-a70e-09380905fed8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:57.871094 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-df250e33-c97d-4a24-a70e-09380905fed8 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1512 microversion: 2.1 time: 0.219152 Jun 20 18:49:57.872556 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 236/482] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:57 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:58.123653 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-aa9419c3-3691-4094-b099-fc2192989295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:58.124203 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-aa9419c3-3691-4094-b099-fc2192989295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:58.130662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-aa9419c3-3691-4094-b099-fc2192989295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:58.131143 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-aa9419c3-3691-4094-b099-fc2192989295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:58.131918 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-aa9419c3-3691-4094-b099-fc2192989295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:58.132347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-aa9419c3-3691-4094-b099-fc2192989295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:58.263950 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-aa9419c3-3691-4094-b099-fc2192989295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:58.271653 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-aa9419c3-3691-4094-b099-fc2192989295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:58.273149 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-aa9419c3-3691-4094-b099-fc2192989295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:58.274282 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-aa9419c3-3691-4094-b099-fc2192989295 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1745 microversion: 2.20 time: 0.155202 Jun 20 18:49:58.274828 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 247/483] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:58 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:58.344795 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ed28ef0c-e6af-4af8-9a12-2de5b9f51f63 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:58.345333 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ed28ef0c-e6af-4af8-9a12-2de5b9f51f63 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:58.351868 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ed28ef0c-e6af-4af8-9a12-2de5b9f51f63 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:58.352326 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ed28ef0c-e6af-4af8-9a12-2de5b9f51f63 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:58.353089 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ed28ef0c-e6af-4af8-9a12-2de5b9f51f63 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:58.353531 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ed28ef0c-e6af-4af8-9a12-2de5b9f51f63 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:58.472672 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e368bf33-309b-4659-9351-d1a701c91242 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:58.474668 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e368bf33-309b-4659-9351-d1a701c91242 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:58.482016 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e368bf33-309b-4659-9351-d1a701c91242 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:58.482717 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e368bf33-309b-4659-9351-d1a701c91242 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:58.483678 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e368bf33-309b-4659-9351-d1a701c91242 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:58.484162 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e368bf33-309b-4659-9351-d1a701c91242 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:58.505935 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ed28ef0c-e6af-4af8-9a12-2de5b9f51f63 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:58.514014 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ed28ef0c-e6af-4af8-9a12-2de5b9f51f63 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1368 microversion: 2.1 time: 0.173977 Jun 20 18:49:58.514575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 237/484] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:58 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:58.573398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-287368b4-a007-4df5-a038-9281f8460f46 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:58.574217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-287368b4-a007-4df5-a038-9281f8460f46 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:58.580259 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-287368b4-a007-4df5-a038-9281f8460f46 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:58.580791 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-287368b4-a007-4df5-a038-9281f8460f46 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:58.581639 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-287368b4-a007-4df5-a038-9281f8460f46 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:58.582139 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-287368b4-a007-4df5-a038-9281f8460f46 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:58.615044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e368bf33-309b-4659-9351-d1a701c91242 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:58.623591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e368bf33-309b-4659-9351-d1a701c91242 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.154677 Jun 20 18:49:58.624169 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 248/485] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:58 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:58.711078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-287368b4-a007-4df5-a038-9281f8460f46 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:58.718674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-287368b4-a007-4df5-a038-9281f8460f46 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.149131 Jun 20 18:49:58.719253 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 238/486] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:58 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:58.888541 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e591dfac-4940-4236-ba47-b7086d1c3927 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:58.889147 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e591dfac-4940-4236-ba47-b7086d1c3927 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:58.895181 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e591dfac-4940-4236-ba47-b7086d1c3927 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:58.895627 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e591dfac-4940-4236-ba47-b7086d1c3927 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:58.896381 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e591dfac-4940-4236-ba47-b7086d1c3927 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:58.896815 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e591dfac-4940-4236-ba47-b7086d1c3927 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:59.024858 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e591dfac-4940-4236-ba47-b7086d1c3927 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:59.032208 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e591dfac-4940-4236-ba47-b7086d1c3927 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1512 microversion: 2.1 time: 0.147478 Jun 20 18:49:59.033168 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 249/487] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:58 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:59.292318 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ec0dd6dd-5377-4ca6-9760-15c20c4bde03 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:59.292919 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ec0dd6dd-5377-4ca6-9760-15c20c4bde03 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:59.298890 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ec0dd6dd-5377-4ca6-9760-15c20c4bde03 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:59.299374 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ec0dd6dd-5377-4ca6-9760-15c20c4bde03 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:59.300118 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ec0dd6dd-5377-4ca6-9760-15c20c4bde03 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:59.300816 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ec0dd6dd-5377-4ca6-9760-15c20c4bde03 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:59.426441 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ec0dd6dd-5377-4ca6-9760-15c20c4bde03 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:59.434343 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ec0dd6dd-5377-4ca6-9760-15c20c4bde03 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:59.435855 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ec0dd6dd-5377-4ca6-9760-15c20c4bde03 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:59.436989 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ec0dd6dd-5377-4ca6-9760-15c20c4bde03 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1745 microversion: 2.20 time: 0.148554 Jun 20 18:49:59.437566 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 239/488] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:49:59 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:49:59.532117 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-df03ce2f-66c5-4449-af01-f863b27fed48 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:59.532724 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-df03ce2f-66c5-4449-af01-f863b27fed48 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:59.539249 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-df03ce2f-66c5-4449-af01-f863b27fed48 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:59.539687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-df03ce2f-66c5-4449-af01-f863b27fed48 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:59.540442 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-df03ce2f-66c5-4449-af01-f863b27fed48 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:59.540869 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-df03ce2f-66c5-4449-af01-f863b27fed48 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:59.641867 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-52360af0-b4bc-45a4-b04c-b2dc177a5f8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:59.642472 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-52360af0-b4bc-45a4-b04c-b2dc177a5f8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:59.648433 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-52360af0-b4bc-45a4-b04c-b2dc177a5f8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:59.648875 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-52360af0-b4bc-45a4-b04c-b2dc177a5f8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:59.649641 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-52360af0-b4bc-45a4-b04c-b2dc177a5f8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:59.650080 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-52360af0-b4bc-45a4-b04c-b2dc177a5f8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:59.687091 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-df03ce2f-66c5-4449-af01-f863b27fed48 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:59.694495 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-df03ce2f-66c5-4449-af01-f863b27fed48 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1368 microversion: 2.1 time: 0.167185 Jun 20 18:49:59.695275 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 250/489] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:59 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:49:59.735626 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-45312c3b-450d-44af-8187-e022d447399a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:49:59.736228 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-45312c3b-450d-44af-8187-e022d447399a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:49:59.742426 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-45312c3b-450d-44af-8187-e022d447399a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:59.742870 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-45312c3b-450d-44af-8187-e022d447399a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:59.743638 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-45312c3b-450d-44af-8187-e022d447399a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:49:59.744112 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-45312c3b-450d-44af-8187-e022d447399a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:49:59.869592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-52360af0-b4bc-45a4-b04c-b2dc177a5f8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:59.874753 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-45312c3b-450d-44af-8187-e022d447399a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:49:59.882680 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-52360af0-b4bc-45a4-b04c-b2dc177a5f8e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.245190 Jun 20 18:49:59.882931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-45312c3b-450d-44af-8187-e022d447399a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.150740 Jun 20 18:49:59.883414 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 251/490] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:59 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:49:59.885166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 240/491] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:49:59 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:00.050143 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-74abb906-d0e5-40a7-88f0-6db454ffbf1a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:00.050827 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-74abb906-d0e5-40a7-88f0-6db454ffbf1a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:00.057062 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-74abb906-d0e5-40a7-88f0-6db454ffbf1a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:00.057585 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-74abb906-d0e5-40a7-88f0-6db454ffbf1a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:00.058888 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-74abb906-d0e5-40a7-88f0-6db454ffbf1a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:00.059941 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-74abb906-d0e5-40a7-88f0-6db454ffbf1a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:00.084076 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-c98f14ce-a116-479d-b0d8-e37c9335c85b req-efe5403a-88f9-42df-9e77-368fe89397c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa52c387-5b77-4644-85c8-691b22dfeb78", "name": "network-vif-plugged", "status": "completed", "tag": "920abf72-084f-4d4e-be79-106c82668c67"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:00.093045 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-c98f14ce-a116-479d-b0d8-e37c9335c85b req-efe5403a-88f9-42df-9e77-368fe89397c0 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:00.093766 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-c98f14ce-a116-479d-b0d8-e37c9335c85b req-efe5403a-88f9-42df-9e77-368fe89397c0 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:00.107056 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-c98f14ce-a116-479d-b0d8-e37c9335c85b req-efe5403a-88f9-42df-9e77-368fe89397c0 service nova] Creating event network-vif-plugged:920abf72-084f-4d4e-be79-106c82668c67 for instance aa52c387-5b77-4644-85c8-691b22dfeb78 on hv-cinder-83697 Jun 20 18:50:00.112262 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-c98f14ce-a116-479d-b0d8-e37c9335c85b req-efe5403a-88f9-42df-9e77-368fe89397c0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031977 Jun 20 18:50:00.113099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 252/492] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:50:00.118120 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-a0fdb007-3c44-4215-8069-b559dbc679db req-5e9fd166-b4eb-411f-9a43-e2af7f187cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8a1109-c502-4228-836f-6ed4a63e6555", "name": "network-vif-deleted", "tag": "420fee3e-2248-4c0d-b858-70fade6db5da"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:00.127546 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-a0fdb007-3c44-4215-8069-b559dbc679db req-5e9fd166-b4eb-411f-9a43-e2af7f187cd1 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:00.128194 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-a0fdb007-3c44-4215-8069-b559dbc679db req-5e9fd166-b4eb-411f-9a43-e2af7f187cd1 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:00.129697 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-74abb906-d0e5-40a7-88f0-6db454ffbf1a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:00.138537 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-74abb906-d0e5-40a7-88f0-6db454ffbf1a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1470 microversion: 2.1 time: 0.092338 Jun 20 18:50:00.139286 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-a0fdb007-3c44-4215-8069-b559dbc679db req-5e9fd166-b4eb-411f-9a43-e2af7f187cd1 service nova] Creating event network-vif-deleted:420fee3e-2248-4c0d-b858-70fade6db5da for instance 0d8a1109-c502-4228-836f-6ed4a63e6555 on hv-cinder-83697 Jun 20 18:50:00.140757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 241/493] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:00 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1470 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:00.155729 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-a0fdb007-3c44-4215-8069-b559dbc679db req-5e9fd166-b4eb-411f-9a43-e2af7f187cd1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039992 Jun 20 18:50:00.156600 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 253/494] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:50:00.455496 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-af482f15-06a5-4a77-954b-33188ad1bd0d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:00.456047 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-af482f15-06a5-4a77-954b-33188ad1bd0d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:00.462383 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-af482f15-06a5-4a77-954b-33188ad1bd0d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:00.462820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-af482f15-06a5-4a77-954b-33188ad1bd0d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:00.463607 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-af482f15-06a5-4a77-954b-33188ad1bd0d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:00.464034 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-af482f15-06a5-4a77-954b-33188ad1bd0d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:00.592941 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-af482f15-06a5-4a77-954b-33188ad1bd0d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:00.600744 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-af482f15-06a5-4a77-954b-33188ad1bd0d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:00.602239 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-af482f15-06a5-4a77-954b-33188ad1bd0d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:00.603410 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-af482f15-06a5-4a77-954b-33188ad1bd0d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1745 microversion: 2.20 time: 0.151847 Jun 20 18:50:00.603949 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 242/495] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:00 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:00.713119 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0d488826-17a1-4db0-8ef8-d396cf36eabe tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:00.713742 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0d488826-17a1-4db0-8ef8-d396cf36eabe tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:00.720708 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0d488826-17a1-4db0-8ef8-d396cf36eabe tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:00.721149 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0d488826-17a1-4db0-8ef8-d396cf36eabe tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:00.721897 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0d488826-17a1-4db0-8ef8-d396cf36eabe tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:00.722322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0d488826-17a1-4db0-8ef8-d396cf36eabe tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:00.848336 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0d488826-17a1-4db0-8ef8-d396cf36eabe tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:00.855619 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0d488826-17a1-4db0-8ef8-d396cf36eabe tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1368 microversion: 2.1 time: 0.147261 Jun 20 18:50:00.856180 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 254/496] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:00 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:00.900183 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-de574756-d59a-409a-bf4f-3149d26383ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:00.900762 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a5bfd79c-d4e4-4c3e-9e71-00ad7c035cfe tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:00.900893 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-de574756-d59a-409a-bf4f-3149d26383ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:00.901377 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a5bfd79c-d4e4-4c3e-9e71-00ad7c035cfe tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:00.907384 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de574756-d59a-409a-bf4f-3149d26383ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:00.907828 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de574756-d59a-409a-bf4f-3149d26383ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:00.907962 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a5bfd79c-d4e4-4c3e-9e71-00ad7c035cfe tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:00.908317 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a5bfd79c-d4e4-4c3e-9e71-00ad7c035cfe tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:00.908579 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de574756-d59a-409a-bf4f-3149d26383ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:00.909017 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de574756-d59a-409a-bf4f-3149d26383ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:00.909111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a5bfd79c-d4e4-4c3e-9e71-00ad7c035cfe tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:00.909495 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a5bfd79c-d4e4-4c3e-9e71-00ad7c035cfe tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:01.040274 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-de574756-d59a-409a-bf4f-3149d26383ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:01.040947 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a5bfd79c-d4e4-4c3e-9e71-00ad7c035cfe tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:01.047923 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-de574756-d59a-409a-bf4f-3149d26383ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1501 microversion: 2.1 time: 0.151575 Jun 20 18:50:01.048583 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 243/497] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:00 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:01.048879 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a5bfd79c-d4e4-4c3e-9e71-00ad7c035cfe tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.152120 Jun 20 18:50:01.049435 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 255/498] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:00 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:01.064765 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0a178836-ae3f-4764-aa2c-48e07c839634 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abeec735-019d-4b56-9c5b-71434a38e323"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:01.065903 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0a178836-ae3f-4764-aa2c-48e07c839634 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:01.071895 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a178836-ae3f-4764-aa2c-48e07c839634 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:01.072346 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a178836-ae3f-4764-aa2c-48e07c839634 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:01.073105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a178836-ae3f-4764-aa2c-48e07c839634 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:01.073542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a178836-ae3f-4764-aa2c-48e07c839634 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:01.096987 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-0a178836-ae3f-4764-aa2c-48e07c839634 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] HTTP exception thrown: Cannot 'attach_volume' instance 4a86d158-0870-4597-be67-25d4f9371977 while it is in vm_state rescued Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0a178836-ae3f-4764-aa2c-48e07c839634 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Request method failure captured: Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: POST /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977/os-volume_attachments HTTP/1.1 Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 74 Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMDgxGdD9NplnDOb9Kvkoi9z6IaPdYfKFk15cOFtxIEbZ3iM6js25CXsTI1b08r7rptp84JQv3s-L6cP6ceMNZuMSW6JZB2WSkrDda2t9Z9oJjBhawuAgtsiksYxhkCbb4o9vew5lG6pfzbGiHzTykEBsXAeqFgzCV--SlTvu97eD9o Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 7b4a919be31b4c74a3197d98ecec7fde Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:50:01.098658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:50:01.100265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b4a919be31b4c74a3197d98ecec7fde", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b4a919be31b4c74a3197d98ecec7fde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b4a919be31b4c74a3197d98ecec7fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b4a919be31b4c74a3197d98ecec7fde"}]}] Jun 20 18:50:01.100265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:50:01.100265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 7b4a919be31b4c74a3197d98ecec7fde Jun 20 18:50:01.100265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:50:01.100265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-ServerRescueNegativeTestJSON-905734882-project Jun 20 18:50:01.100265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:50:01.100265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:50:01.100265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 31fed190cac24d1b8326425f737e220b Jun 20 18:50:01.100265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-ServerRescueNegativeTestJSON-905734882-project Jun 20 18:50:01.100265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Jun 20 18:50:01.100265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {"volumeAttachment": {"volumeId": "abeec735-019d-4b56-9c5b-71434a38e323"}} Jun 20 18:50:01.100265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Cannot 'attach_volume' instance 4a86d158-0870-4597-be67-25d4f9371977 while it is in vm_state rescued Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'server_id': '4a86d158-0870-4597-be67-25d4f9371977', 'body': {'volumeAttachment': {'volumeId': 'abeec735-019d-4b56-9c5b-71434a38e323'}}} Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a86d158-0870-4597-be67-25d4f9371977 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:50:01.101123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4a86d158-0870-4597-be67-25d4f9371977 while it is in vm_state rescued Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:50:01.102522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:50:01.103878 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:50:01.103878 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:50:01.103878 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4a86d158-0870-4597-be67-25d4f9371977 while it is in vm_state rescued Jun 20 18:50:01.103878 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:50:01.103878 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0a178836-ae3f-4764-aa2c-48e07c839634 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Returning 409 to user: Cannot 'attach_volume' instance 4a86d158-0870-4597-be67-25d4f9371977 while it is in vm_state rescued {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:50:01.103878 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0a178836-ae3f-4764-aa2c-48e07c839634 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "POST /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039510 Jun 20 18:50:01.103878 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 244/499] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jun 20 18:50:01 2022] POST /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 18:50:01.108742 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fb4634eb-6695-48cb-9f8f-fd95ece3373f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:01.109269 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fb4634eb-6695-48cb-9f8f-fd95ece3373f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:01.115418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb4634eb-6695-48cb-9f8f-fd95ece3373f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:01.115866 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb4634eb-6695-48cb-9f8f-fd95ece3373f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:01.118337 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb4634eb-6695-48cb-9f8f-fd95ece3373f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:01.118782 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb4634eb-6695-48cb-9f8f-fd95ece3373f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:01.156585 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-acd0da4c-792d-44ef-a8d8-d639b6992a01 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:01.157442 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-acd0da4c-792d-44ef-a8d8-d639b6992a01 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:01.164345 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-acd0da4c-792d-44ef-a8d8-d639b6992a01 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:01.164791 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-acd0da4c-792d-44ef-a8d8-d639b6992a01 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:01.165546 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-acd0da4c-792d-44ef-a8d8-d639b6992a01 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:01.165980 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-acd0da4c-792d-44ef-a8d8-d639b6992a01 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:01.186655 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fb4634eb-6695-48cb-9f8f-fd95ece3373f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "POST /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977/action" status: 202 len: 0 microversion: 2.1 time: 0.081482 Jun 20 18:50:01.190261 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 256/500] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jun 20 18:50:01 2022] POST /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:50:01.195544 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-617ee944-db81-4cbd-9a71-d7341418da55 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:01.196228 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-617ee944-db81-4cbd-9a71-d7341418da55 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:01.202946 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-617ee944-db81-4cbd-9a71-d7341418da55 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:01.203417 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-617ee944-db81-4cbd-9a71-d7341418da55 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:01.204172 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-617ee944-db81-4cbd-9a71-d7341418da55 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:01.204601 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-617ee944-db81-4cbd-9a71-d7341418da55 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:01.232317 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-acd0da4c-792d-44ef-a8d8-d639b6992a01 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:01.239911 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-acd0da4c-792d-44ef-a8d8-d639b6992a01 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1303 microversion: 2.1 time: 0.087213 Jun 20 18:50:01.240399 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 245/501] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:01 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1303 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:01.338439 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-617ee944-db81-4cbd-9a71-d7341418da55 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:01.345788 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-617ee944-db81-4cbd-9a71-d7341418da55 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1509 microversion: 2.1 time: 0.154196 Jun 20 18:50:01.346344 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 257/502] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:01 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:01.621400 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c98d75a8-6002-4beb-aa86-395663fbca70 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:01.622000 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c98d75a8-6002-4beb-aa86-395663fbca70 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:01.628437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c98d75a8-6002-4beb-aa86-395663fbca70 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:01.628876 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c98d75a8-6002-4beb-aa86-395663fbca70 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:01.629653 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c98d75a8-6002-4beb-aa86-395663fbca70 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:01.630079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c98d75a8-6002-4beb-aa86-395663fbca70 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:01.632656 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=100 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:01.757495 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c98d75a8-6002-4beb-aa86-395663fbca70 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:01.765306 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c98d75a8-6002-4beb-aa86-395663fbca70 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:01.766786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c98d75a8-6002-4beb-aa86-395663fbca70 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:01.767954 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c98d75a8-6002-4beb-aa86-395663fbca70 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1745 microversion: 2.20 time: 0.150437 Jun 20 18:50:01.768502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 246/503] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:01 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:01.872890 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b376d069-6c0e-4cc2-b74c-76b849807ed2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:01.873503 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b376d069-6c0e-4cc2-b74c-76b849807ed2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:01.879966 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b376d069-6c0e-4cc2-b74c-76b849807ed2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:01.880443 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b376d069-6c0e-4cc2-b74c-76b849807ed2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:01.881221 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b376d069-6c0e-4cc2-b74c-76b849807ed2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:01.881657 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b376d069-6c0e-4cc2-b74c-76b849807ed2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:02.018540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b376d069-6c0e-4cc2-b74c-76b849807ed2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:02.025828 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b376d069-6c0e-4cc2-b74c-76b849807ed2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1368 microversion: 2.1 time: 0.157483 Jun 20 18:50:02.026384 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 258/504] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:01 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:02.065746 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b43f0739-0824-49a2-a6cd-109112e90883 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:02.066346 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b43f0739-0824-49a2-a6cd-109112e90883 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:02.072366 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b43f0739-0824-49a2-a6cd-109112e90883 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:02.072806 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b43f0739-0824-49a2-a6cd-109112e90883 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:02.073557 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b43f0739-0824-49a2-a6cd-109112e90883 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:02.073985 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b43f0739-0824-49a2-a6cd-109112e90883 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:02.202243 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b43f0739-0824-49a2-a6cd-109112e90883 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:02.210357 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b43f0739-0824-49a2-a6cd-109112e90883 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.148456 Jun 20 18:50:02.210932 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 247/505] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:02 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:02.258468 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-52fcbbab-add8-4768-b952-a55265272a4e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:02.259115 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-52fcbbab-add8-4768-b952-a55265272a4e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:02.265847 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-52fcbbab-add8-4768-b952-a55265272a4e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:02.266329 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-52fcbbab-add8-4768-b952-a55265272a4e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:02.267214 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-52fcbbab-add8-4768-b952-a55265272a4e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:02.267678 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-52fcbbab-add8-4768-b952-a55265272a4e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:02.303346 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-52fcbbab-add8-4768-b952-a55265272a4e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:02.303785 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-52fcbbab-add8-4768-b952-a55265272a4e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:02.304263 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-52fcbbab-add8-4768-b952-a55265272a4e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lazy-loading 'fault' on Instance uuid 0d8a1109-c502-4228-836f-6ed4a63e6555 {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:50:02.347773 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-52fcbbab-add8-4768-b952-a55265272a4e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:02.355388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-52fcbbab-add8-4768-b952-a55265272a4e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1308 microversion: 2.1 time: 0.102991 Jun 20 18:50:02.356466 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 259/506] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:02 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:02.363141 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b58ed823-1970-4a31-931b-4773240a7413 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:02.363842 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b58ed823-1970-4a31-931b-4773240a7413 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:02.369960 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b58ed823-1970-4a31-931b-4773240a7413 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:02.370405 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b58ed823-1970-4a31-931b-4773240a7413 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:02.371212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b58ed823-1970-4a31-931b-4773240a7413 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:02.372196 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b58ed823-1970-4a31-931b-4773240a7413 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:02.498347 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b58ed823-1970-4a31-931b-4773240a7413 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:02.505730 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b58ed823-1970-4a31-931b-4773240a7413 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1509 microversion: 2.1 time: 0.146795 Jun 20 18:50:02.506284 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 248/507] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:02 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:02.785508 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-898b7679-7481-4b36-8edf-e93299e100d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:02.786114 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-898b7679-7481-4b36-8edf-e93299e100d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:02.792413 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-898b7679-7481-4b36-8edf-e93299e100d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:02.792859 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-898b7679-7481-4b36-8edf-e93299e100d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:02.794251 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-898b7679-7481-4b36-8edf-e93299e100d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:02.794687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-898b7679-7481-4b36-8edf-e93299e100d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:02.797305 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:02.923418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-898b7679-7481-4b36-8edf-e93299e100d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:02.931362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-898b7679-7481-4b36-8edf-e93299e100d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:02.932860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-898b7679-7481-4b36-8edf-e93299e100d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:02.934027 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-898b7679-7481-4b36-8edf-e93299e100d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1745 microversion: 2.20 time: 0.152433 Jun 20 18:50:02.934579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 260/508] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:02 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:03.043526 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1209034a-6136-4ee2-9325-36c507d2e543 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:03.044128 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1209034a-6136-4ee2-9325-36c507d2e543 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:03.051322 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1209034a-6136-4ee2-9325-36c507d2e543 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:03.051762 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1209034a-6136-4ee2-9325-36c507d2e543 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:03.052582 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1209034a-6136-4ee2-9325-36c507d2e543 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:03.053015 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1209034a-6136-4ee2-9325-36c507d2e543 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:03.176920 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-1209034a-6136-4ee2-9325-36c507d2e543 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:03.184230 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1209034a-6136-4ee2-9325-36c507d2e543 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1557 microversion: 2.1 time: 0.144849 Jun 20 18:50:03.184787 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 249/509] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:03 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:03.200563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0fdbafea-772a-49a2-9291-c477a74c49b8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:03.201069 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0fdbafea-772a-49a2-9291-c477a74c49b8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:03.206994 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0fdbafea-772a-49a2-9291-c477a74c49b8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:03.207433 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0fdbafea-772a-49a2-9291-c477a74c49b8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:03.208178 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0fdbafea-772a-49a2-9291-c477a74c49b8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:03.208604 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0fdbafea-772a-49a2-9291-c477a74c49b8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:03.227356 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0749b5f5-eed4-467b-b550-537c1df47cf0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:03.227895 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0749b5f5-eed4-467b-b550-537c1df47cf0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:03.233863 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0749b5f5-eed4-467b-b550-537c1df47cf0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:03.234314 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0749b5f5-eed4-467b-b550-537c1df47cf0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:03.235107 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0749b5f5-eed4-467b-b550-537c1df47cf0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:03.235545 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0749b5f5-eed4-467b-b550-537c1df47cf0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:03.284502 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0fdbafea-772a-49a2-9291-c477a74c49b8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088159 Jun 20 18:50:03.285225 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 261/510] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jun 20 18:50:03 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:50:03.372615 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0749b5f5-eed4-467b-b550-537c1df47cf0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:03.373686 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e1811963-a96e-44cb-a614-45fcff2839f1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:03.374295 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e1811963-a96e-44cb-a614-45fcff2839f1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:03.383480 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e1811963-a96e-44cb-a614-45fcff2839f1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:03.386422 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0749b5f5-eed4-467b-b550-537c1df47cf0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.162836 Jun 20 18:50:03.387766 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e1811963-a96e-44cb-a614-45fcff2839f1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:03.388556 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e1811963-a96e-44cb-a614-45fcff2839f1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:03.389208 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e1811963-a96e-44cb-a614-45fcff2839f1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:03.395415 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 250/511] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:03 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:03.438813 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e1811963-a96e-44cb-a614-45fcff2839f1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:03.439371 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e1811963-a96e-44cb-a614-45fcff2839f1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:03.439947 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-e1811963-a96e-44cb-a614-45fcff2839f1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lazy-loading 'fault' on Instance uuid 0d8a1109-c502-4228-836f-6ed4a63e6555 {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:50:03.489378 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e1811963-a96e-44cb-a614-45fcff2839f1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:03.499518 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e1811963-a96e-44cb-a614-45fcff2839f1 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 200 len: 1308 microversion: 2.1 time: 0.130020 Jun 20 18:50:03.500109 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 262/512] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:03 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 1308 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:03.523694 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-98bfd045-499e-4353-9561-f482ce4724b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:03.524637 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-98bfd045-499e-4353-9561-f482ce4724b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:03.530208 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:03.532705 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-98bfd045-499e-4353-9561-f482ce4724b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:03.533107 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-98bfd045-499e-4353-9561-f482ce4724b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:03.534037 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-98bfd045-499e-4353-9561-f482ce4724b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:03.534480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-98bfd045-499e-4353-9561-f482ce4724b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:03.735739 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-98bfd045-499e-4353-9561-f482ce4724b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:03.749739 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-98bfd045-499e-4353-9561-f482ce4724b1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1509 microversion: 2.1 time: 0.229061 Jun 20 18:50:03.749739 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 251/513] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:03 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:03.952694 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8a63c120-9a8f-4fe1-8d71-8958a561ad67 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:03.953309 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8a63c120-9a8f-4fe1-8d71-8958a561ad67 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:03.961113 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a63c120-9a8f-4fe1-8d71-8958a561ad67 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:03.961834 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a63c120-9a8f-4fe1-8d71-8958a561ad67 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:03.962617 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a63c120-9a8f-4fe1-8d71-8958a561ad67 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:03.963096 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a63c120-9a8f-4fe1-8d71-8958a561ad67 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:04.322356 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8a63c120-9a8f-4fe1-8d71-8958a561ad67 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:04.330978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8a63c120-9a8f-4fe1-8d71-8958a561ad67 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:04.332487 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8a63c120-9a8f-4fe1-8d71-8958a561ad67 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:04.333638 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8a63c120-9a8f-4fe1-8d71-8958a561ad67 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1745 microversion: 2.20 time: 0.385459 Jun 20 18:50:04.334194 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 263/514] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:03 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1745 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:04.411114 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-fe2a51a4-1372-4a62-9e3a-39e01273d93e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:04.411815 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-fe2a51a4-1372-4a62-9e3a-39e01273d93e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:04.418672 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fe2a51a4-1372-4a62-9e3a-39e01273d93e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:04.419169 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fe2a51a4-1372-4a62-9e3a-39e01273d93e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:04.419928 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fe2a51a4-1372-4a62-9e3a-39e01273d93e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:04.420357 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fe2a51a4-1372-4a62-9e3a-39e01273d93e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:04.516925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7fc1a902-d741-4d8d-b4bf-1bd5f209ecb5 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:04.517534 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7fc1a902-d741-4d8d-b4bf-1bd5f209ecb5 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 0d8a1109-c502-4228-836f-6ed4a63e6555] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:04.523551 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7fc1a902-d741-4d8d-b4bf-1bd5f209ecb5 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:04.523993 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7fc1a902-d741-4d8d-b4bf-1bd5f209ecb5 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:04.524747 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7fc1a902-d741-4d8d-b4bf-1bd5f209ecb5 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:04.525329 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7fc1a902-d741-4d8d-b4bf-1bd5f209ecb5 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:04.539547 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-7fc1a902-d741-4d8d-b4bf-1bd5f209ecb5 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] HTTP exception thrown: Instance 0d8a1109-c502-4228-836f-6ed4a63e6555 could not be found. Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7fc1a902-d741-4d8d-b4bf-1bd5f209ecb5 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Request method failure captured: Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 HTTP/1.1 Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMDb3_1uHEyhurn0QcPGo54yyBFseR2pcfVL-ONxzDHHWu2KECn6M3cWUtTBJsFL-R4EYs1itlf35mzHDoVUhxuF5ocLEHEYCTXBnmJRM-UadqmiD9yVx-V3VHeUnjDqwYhfUirWoDTbNrWE7UWAMeOfJv86iY3UHWIK_qhGgSz4vVo Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 98d56a21c52b49ffbc838f590fe76d29 Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1010800504 Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:50:04.541197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:50:04.542673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_98d56a21c52b49ffbc838f590fe76d29", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/98d56a21c52b49ffbc838f590fe76d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/98d56a21c52b49ffbc838f590fe76d29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/98d56a21c52b49ffbc838f590fe76d29"}]}] Jun 20 18:50:04.542673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-VolumesSnapshotTestJSON-1010800504 Jun 20 18:50:04.542673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 98d56a21c52b49ffbc838f590fe76d29 Jun 20 18:50:04.542673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1010800504 Jun 20 18:50:04.542673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-VolumesSnapshotTestJSON-1010800504-project Jun 20 18:50:04.542673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:50:04.542673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:50:04.542673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 27e3a6db1a9b4c38bb8a5697ed08f8e7 Jun 20 18:50:04.542673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-VolumesSnapshotTestJSON-1010800504-project Jun 20 18:50:04.542673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:50:04.542673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance 0d8a1109-c502-4228-836f-6ed4a63e6555 could not be found. Jun 20 18:50:04.542673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '0d8a1109-c502-4228-836f-6ed4a63e6555'} Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d8a1109-c502-4228-836f-6ed4a63e6555 could not be found. Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:50:04.544053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d8a1109-c502-4228-836f-6ed4a63e6555 could not be found. Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d8a1109-c502-4228-836f-6ed4a63e6555 could not be found. Jun 20 18:50:04.545323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:50:04.547677 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7fc1a902-d741-4d8d-b4bf-1bd5f209ecb5 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Returning 404 to user: Instance 0d8a1109-c502-4228-836f-6ed4a63e6555 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:50:04.552342 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-fe2a51a4-1372-4a62-9e3a-39e01273d93e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:04.555929 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7fc1a902-d741-4d8d-b4bf-1bd5f209ecb5 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555" status: 404 len: 111 microversion: 2.1 time: 0.035785 Jun 20 18:50:04.559403 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 264/515] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:04 2022] GET /compute/v2.1/servers/0d8a1109-c502-4228-836f-6ed4a63e6555 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:50:04.562143 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-fe2a51a4-1372-4a62-9e3a-39e01273d93e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.154740 Jun 20 18:50:04.563186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 252/516] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:04 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:04.588336 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-9446ca53-542c-4d46-81dd-6552ac6d6c85 req-3ebde518-6544-4018-9b0c-69319d145a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6efd07f2-b56d-4cc1-8187-d6d3afca2c86", "tag": "28f8401e-b1a6-48d5-8f19-cf2b25578a52"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:04.596749 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-9446ca53-542c-4d46-81dd-6552ac6d6c85 req-3ebde518-6544-4018-9b0c-69319d145a0f service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:04.597278 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-9446ca53-542c-4d46-81dd-6552ac6d6c85 req-3ebde518-6544-4018-9b0c-69319d145a0f service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:04.611636 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-9446ca53-542c-4d46-81dd-6552ac6d6c85 req-3ebde518-6544-4018-9b0c-69319d145a0f service nova] Creating event network-changed:28f8401e-b1a6-48d5-8f19-cf2b25578a52 for instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 on hv-cinder-83697 Jun 20 18:50:04.616791 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-9446ca53-542c-4d46-81dd-6552ac6d6c85 req-3ebde518-6544-4018-9b0c-69319d145a0f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032443 Jun 20 18:50:04.617561 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 265/517] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:50:04.766428 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-999b914a-c510-4e9c-9e00-fd2bbd4bec20 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:04.767073 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-999b914a-c510-4e9c-9e00-fd2bbd4bec20 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:04.773232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-999b914a-c510-4e9c-9e00-fd2bbd4bec20 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:04.773712 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-999b914a-c510-4e9c-9e00-fd2bbd4bec20 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:04.774478 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-999b914a-c510-4e9c-9e00-fd2bbd4bec20 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:04.774933 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-999b914a-c510-4e9c-9e00-fd2bbd4bec20 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:04.913406 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-999b914a-c510-4e9c-9e00-fd2bbd4bec20 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:04.921302 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-999b914a-c510-4e9c-9e00-fd2bbd4bec20 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1509 microversion: 2.1 time: 0.159645 Jun 20 18:50:04.921867 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 253/518] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:04 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:05.352805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b90a9184-2665-4652-9007-250a04c4f88c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:05.353565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b90a9184-2665-4652-9007-250a04c4f88c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:05.359739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b90a9184-2665-4652-9007-250a04c4f88c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:05.360182 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b90a9184-2665-4652-9007-250a04c4f88c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:05.360931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b90a9184-2665-4652-9007-250a04c4f88c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:05.361360 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b90a9184-2665-4652-9007-250a04c4f88c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:05.493785 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b90a9184-2665-4652-9007-250a04c4f88c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:05.501711 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b90a9184-2665-4652-9007-250a04c4f88c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:05.503237 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b90a9184-2665-4652-9007-250a04c4f88c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:05.504407 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b90a9184-2665-4652-9007-250a04c4f88c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1745 microversion: 2.20 time: 0.156443 Jun 20 18:50:05.504969 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 266/519] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:05 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:05.581599 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-650e67cc-5c35-499e-bce2-29ea1314f0ca tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:05.582438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-650e67cc-5c35-499e-bce2-29ea1314f0ca tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:05.591406 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-650e67cc-5c35-499e-bce2-29ea1314f0ca tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:05.592089 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-650e67cc-5c35-499e-bce2-29ea1314f0ca tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:05.593067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-650e67cc-5c35-499e-bce2-29ea1314f0ca tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:05.593664 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-650e67cc-5c35-499e-bce2-29ea1314f0ca tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:05.732930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-650e67cc-5c35-499e-bce2-29ea1314f0ca tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:05.741314 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-650e67cc-5c35-499e-bce2-29ea1314f0ca tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.163722 Jun 20 18:50:05.741903 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 254/520] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:05 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:05.937880 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5c722043-b1ab-428b-b328-1d91e0cafa04 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:05.938495 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5c722043-b1ab-428b-b328-1d91e0cafa04 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:05.944543 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5c722043-b1ab-428b-b328-1d91e0cafa04 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:05.944985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5c722043-b1ab-428b-b328-1d91e0cafa04 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:05.945771 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5c722043-b1ab-428b-b328-1d91e0cafa04 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:05.946199 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5c722043-b1ab-428b-b328-1d91e0cafa04 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:06.077018 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5c722043-b1ab-428b-b328-1d91e0cafa04 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:06.084459 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5c722043-b1ab-428b-b328-1d91e0cafa04 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1509 microversion: 2.1 time: 0.150922 Jun 20 18:50:06.085034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 267/521] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:05 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:06.523610 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a4a178d8-645b-4042-94ff-d95f870097a4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:06.524217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a4a178d8-645b-4042-94ff-d95f870097a4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:06.530439 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a4a178d8-645b-4042-94ff-d95f870097a4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:06.530947 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a4a178d8-645b-4042-94ff-d95f870097a4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:06.531720 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a4a178d8-645b-4042-94ff-d95f870097a4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:06.532149 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a4a178d8-645b-4042-94ff-d95f870097a4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:06.661285 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a4a178d8-645b-4042-94ff-d95f870097a4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:06.669560 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a4a178d8-645b-4042-94ff-d95f870097a4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:06.671094 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a4a178d8-645b-4042-94ff-d95f870097a4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:06.672236 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a4a178d8-645b-4042-94ff-d95f870097a4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1745 microversion: 2.20 time: 0.152632 Jun 20 18:50:06.672791 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 255/522] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:06 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:06.759083 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-64402651-bf77-4403-a7eb-f8aec26b502a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:06.759691 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-64402651-bf77-4403-a7eb-f8aec26b502a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:06.766829 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-64402651-bf77-4403-a7eb-f8aec26b502a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:06.767324 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-64402651-bf77-4403-a7eb-f8aec26b502a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:06.768074 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-64402651-bf77-4403-a7eb-f8aec26b502a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:06.768508 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-64402651-bf77-4403-a7eb-f8aec26b502a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:06.893938 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-64402651-bf77-4403-a7eb-f8aec26b502a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:06.901916 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-64402651-bf77-4403-a7eb-f8aec26b502a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.146707 Jun 20 18:50:06.903193 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 268/523] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:06 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:07.100738 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-bdb8cca5-1860-424d-b530-50dcb17d6969 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:07.101268 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-bdb8cca5-1860-424d-b530-50dcb17d6969 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:07.108934 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bdb8cca5-1860-424d-b530-50dcb17d6969 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:07.109377 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bdb8cca5-1860-424d-b530-50dcb17d6969 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:07.110137 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bdb8cca5-1860-424d-b530-50dcb17d6969 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:07.110570 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bdb8cca5-1860-424d-b530-50dcb17d6969 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:07.236380 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-bdb8cca5-1860-424d-b530-50dcb17d6969 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:07.244364 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-bdb8cca5-1860-424d-b530-50dcb17d6969 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1509 microversion: 2.1 time: 0.147519 Jun 20 18:50:07.244939 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 256/524] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:07 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:07.690122 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4efa3942-e644-4a4d-8e70-fea56e6f1d37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:07.690723 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-4efa3942-e644-4a4d-8e70-fea56e6f1d37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:07.697402 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4efa3942-e644-4a4d-8e70-fea56e6f1d37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:07.697839 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4efa3942-e644-4a4d-8e70-fea56e6f1d37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:07.698595 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4efa3942-e644-4a4d-8e70-fea56e6f1d37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:07.699056 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4efa3942-e644-4a4d-8e70-fea56e6f1d37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:07.826194 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-4efa3942-e644-4a4d-8e70-fea56e6f1d37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:07.833956 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-4efa3942-e644-4a4d-8e70-fea56e6f1d37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:07.835621 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-4efa3942-e644-4a4d-8e70-fea56e6f1d37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:07.836636 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4efa3942-e644-4a4d-8e70-fea56e6f1d37 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1745 microversion: 2.20 time: 0.150403 Jun 20 18:50:07.837258 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 269/525] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:07 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:07.918556 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b2dfd3b5-68ca-483f-84b2-556121005ede tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:07.919186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b2dfd3b5-68ca-483f-84b2-556121005ede tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:07.926837 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b2dfd3b5-68ca-483f-84b2-556121005ede tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:07.927265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b2dfd3b5-68ca-483f-84b2-556121005ede tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:07.928298 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b2dfd3b5-68ca-483f-84b2-556121005ede tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:07.928832 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b2dfd3b5-68ca-483f-84b2-556121005ede tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:08.056681 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b2dfd3b5-68ca-483f-84b2-556121005ede tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:08.065235 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b2dfd3b5-68ca-483f-84b2-556121005ede tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.150505 Jun 20 18:50:08.065791 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 257/526] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:07 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:08.261288 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-79133d34-c94c-4942-b4a9-c56beb2b7c31 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:08.262408 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-79133d34-c94c-4942-b4a9-c56beb2b7c31 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:08.268434 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-79133d34-c94c-4942-b4a9-c56beb2b7c31 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:08.268878 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-79133d34-c94c-4942-b4a9-c56beb2b7c31 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:08.269627 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-79133d34-c94c-4942-b4a9-c56beb2b7c31 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:08.270058 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-79133d34-c94c-4942-b4a9-c56beb2b7c31 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:08.397813 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-79133d34-c94c-4942-b4a9-c56beb2b7c31 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:08.406106 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-79133d34-c94c-4942-b4a9-c56beb2b7c31 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1509 microversion: 2.1 time: 0.148817 Jun 20 18:50:08.406662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 270/527] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:08 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:08.854114 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0a1c8769-3600-4831-b961-eda5ca0e1816 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:08.854723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0a1c8769-3600-4831-b961-eda5ca0e1816 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:08.860712 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a1c8769-3600-4831-b961-eda5ca0e1816 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:08.861169 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a1c8769-3600-4831-b961-eda5ca0e1816 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:08.861910 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a1c8769-3600-4831-b961-eda5ca0e1816 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:08.862347 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a1c8769-3600-4831-b961-eda5ca0e1816 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:08.993348 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0a1c8769-3600-4831-b961-eda5ca0e1816 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:09.001293 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0a1c8769-3600-4831-b961-eda5ca0e1816 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:09.002800 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0a1c8769-3600-4831-b961-eda5ca0e1816 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:09.003993 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0a1c8769-3600-4831-b961-eda5ca0e1816 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1745 microversion: 2.20 time: 0.153813 Jun 20 18:50:09.004545 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 258/528] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:08 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:09.082449 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4627c9b7-7a2b-4264-afbc-3301f1876feb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:09.083123 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-4627c9b7-7a2b-4264-afbc-3301f1876feb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:09.089563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4627c9b7-7a2b-4264-afbc-3301f1876feb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:09.090641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4627c9b7-7a2b-4264-afbc-3301f1876feb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:09.091429 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4627c9b7-7a2b-4264-afbc-3301f1876feb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:09.091867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4627c9b7-7a2b-4264-afbc-3301f1876feb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:09.217654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-4627c9b7-7a2b-4264-afbc-3301f1876feb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:09.225549 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4627c9b7-7a2b-4264-afbc-3301f1876feb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.146987 Jun 20 18:50:09.226109 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 271/529] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:09 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:09.422943 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-20554916-5377-4819-ab4d-c0e3092acd2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:09.423563 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-20554916-5377-4819-ab4d-c0e3092acd2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:09.429457 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-20554916-5377-4819-ab4d-c0e3092acd2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:09.429899 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-20554916-5377-4819-ab4d-c0e3092acd2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:09.430651 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-20554916-5377-4819-ab4d-c0e3092acd2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:09.431120 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-20554916-5377-4819-ab4d-c0e3092acd2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:09.559314 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-20554916-5377-4819-ab4d-c0e3092acd2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:09.566682 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-20554916-5377-4819-ab4d-c0e3092acd2d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1509 microversion: 2.1 time: 0.147636 Jun 20 18:50:09.567268 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 259/530] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:09 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:10.021257 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-76175cbd-9012-45cf-97fe-c48863024133 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:10.021895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-76175cbd-9012-45cf-97fe-c48863024133 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:10.027872 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-76175cbd-9012-45cf-97fe-c48863024133 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:10.028318 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-76175cbd-9012-45cf-97fe-c48863024133 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:10.029076 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-76175cbd-9012-45cf-97fe-c48863024133 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:10.029505 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-76175cbd-9012-45cf-97fe-c48863024133 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:10.169160 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-76175cbd-9012-45cf-97fe-c48863024133 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:10.176893 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-76175cbd-9012-45cf-97fe-c48863024133 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:10.178376 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-76175cbd-9012-45cf-97fe-c48863024133 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:10.179538 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-76175cbd-9012-45cf-97fe-c48863024133 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1745 microversion: 2.20 time: 0.162093 Jun 20 18:50:10.180083 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 272/531] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:10 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:10.242196 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a6b78c8a-b61f-4fad-8008-ff17ba99e363 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:10.242808 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a6b78c8a-b61f-4fad-8008-ff17ba99e363 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:10.249375 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a6b78c8a-b61f-4fad-8008-ff17ba99e363 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:10.249836 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a6b78c8a-b61f-4fad-8008-ff17ba99e363 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:10.250602 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a6b78c8a-b61f-4fad-8008-ff17ba99e363 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:10.251071 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a6b78c8a-b61f-4fad-8008-ff17ba99e363 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:10.383074 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a6b78c8a-b61f-4fad-8008-ff17ba99e363 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:10.390934 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a6b78c8a-b61f-4fad-8008-ff17ba99e363 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1722 microversion: 2.1 time: 0.152596 Jun 20 18:50:10.391516 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 260/532] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:10 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:10.583729 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9af72dbc-4cb7-4757-8431-513d5ab450d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:10.584293 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9af72dbc-4cb7-4757-8431-513d5ab450d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:10.590264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9af72dbc-4cb7-4757-8431-513d5ab450d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:10.590704 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9af72dbc-4cb7-4757-8431-513d5ab450d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:10.591490 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9af72dbc-4cb7-4757-8431-513d5ab450d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:10.591921 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9af72dbc-4cb7-4757-8431-513d5ab450d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:10.718408 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9af72dbc-4cb7-4757-8431-513d5ab450d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:10.725908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9af72dbc-4cb7-4757-8431-513d5ab450d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1509 microversion: 2.1 time: 0.146069 Jun 20 18:50:10.726464 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 273/533] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:10 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:11.198177 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2a80eb0d-8e4c-49e2-93e4-b5825165af56 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:11.199048 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2a80eb0d-8e4c-49e2-93e4-b5825165af56 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:11.205631 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2a80eb0d-8e4c-49e2-93e4-b5825165af56 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:11.206083 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2a80eb0d-8e4c-49e2-93e4-b5825165af56 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:11.206858 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2a80eb0d-8e4c-49e2-93e4-b5825165af56 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:11.207504 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2a80eb0d-8e4c-49e2-93e4-b5825165af56 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:11.354543 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2a80eb0d-8e4c-49e2-93e4-b5825165af56 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:11.366858 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2a80eb0d-8e4c-49e2-93e4-b5825165af56 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:11.368419 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2a80eb0d-8e4c-49e2-93e4-b5825165af56 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:11.369975 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2a80eb0d-8e4c-49e2-93e4-b5825165af56 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.176177 Jun 20 18:50:11.370704 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 261/534] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:11 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:11.409246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0c473e88-4d2f-461a-80a8-dbbb0e1cef41 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:11.409640 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0c473e88-4d2f-461a-80a8-dbbb0e1cef41 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:11.416191 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0c473e88-4d2f-461a-80a8-dbbb0e1cef41 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:11.416627 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0c473e88-4d2f-461a-80a8-dbbb0e1cef41 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:11.417402 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0c473e88-4d2f-461a-80a8-dbbb0e1cef41 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:11.417850 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0c473e88-4d2f-461a-80a8-dbbb0e1cef41 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:11.547431 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0c473e88-4d2f-461a-80a8-dbbb0e1cef41 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:11.555510 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0c473e88-4d2f-461a-80a8-dbbb0e1cef41 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1699 microversion: 2.1 time: 0.150581 Jun 20 18:50:11.556062 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 274/535] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:11 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1699 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:11.572269 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-cb6a9b31-80f6-4e2d-ad27-33e18b38f48d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:11.578186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cb6a9b31-80f6-4e2d-ad27-33e18b38f48d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:11.578628 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cb6a9b31-80f6-4e2d-ad27-33e18b38f48d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:11.599497 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-cb6a9b31-80f6-4e2d-ad27-33e18b38f48d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Going to try to start instance {{(pid=124190) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 18:50:11.603583 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=100 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:11.639330 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-cb6a9b31-80f6-4e2d-ad27-33e18b38f48d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "POST /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/action" status: 202 len: 0 microversion: 2.1 time: 0.070557 Jun 20 18:50:11.639833 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 262/536] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jun 20 18:50:11 2022] POST /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:50:11.647921 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f915f30f-f6c0-4925-abd0-92eaf27ad2a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:11.648565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f915f30f-f6c0-4925-abd0-92eaf27ad2a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:11.655055 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f915f30f-f6c0-4925-abd0-92eaf27ad2a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:11.655504 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f915f30f-f6c0-4925-abd0-92eaf27ad2a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:11.656264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f915f30f-f6c0-4925-abd0-92eaf27ad2a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:11.656698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f915f30f-f6c0-4925-abd0-92eaf27ad2a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:11.743895 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-72cfb9ed-284e-456a-8669-a02712c670b6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:11.744614 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-72cfb9ed-284e-456a-8669-a02712c670b6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:11.750861 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-72cfb9ed-284e-456a-8669-a02712c670b6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:11.751331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-72cfb9ed-284e-456a-8669-a02712c670b6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:11.752087 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-72cfb9ed-284e-456a-8669-a02712c670b6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:11.752518 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-72cfb9ed-284e-456a-8669-a02712c670b6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:11.785901 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f915f30f-f6c0-4925-abd0-92eaf27ad2a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:11.794655 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f915f30f-f6c0-4925-abd0-92eaf27ad2a9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1708 microversion: 2.1 time: 0.150521 Jun 20 18:50:11.795254 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 275/537] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:11 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:11.881859 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-72cfb9ed-284e-456a-8669-a02712c670b6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:11.889287 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-72cfb9ed-284e-456a-8669-a02712c670b6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1515 microversion: 2.1 time: 0.149620 Jun 20 18:50:11.889889 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 263/538] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:11 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:12.388443 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-93c5da01-3412-4e2e-b4a8-919bef1c6d4b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:12.389044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-93c5da01-3412-4e2e-b4a8-919bef1c6d4b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:12.395079 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-93c5da01-3412-4e2e-b4a8-919bef1c6d4b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:12.395472 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-93c5da01-3412-4e2e-b4a8-919bef1c6d4b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:12.396213 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-93c5da01-3412-4e2e-b4a8-919bef1c6d4b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:12.396641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-93c5da01-3412-4e2e-b4a8-919bef1c6d4b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:12.522905 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-93c5da01-3412-4e2e-b4a8-919bef1c6d4b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:12.531337 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-93c5da01-3412-4e2e-b4a8-919bef1c6d4b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:12.532852 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-93c5da01-3412-4e2e-b4a8-919bef1c6d4b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:12.533993 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-93c5da01-3412-4e2e-b4a8-919bef1c6d4b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.149525 Jun 20 18:50:12.534540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 276/539] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:12 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:12.811650 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d670e2d3-e196-4d58-8e13-d22139202fd5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:12.812248 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d670e2d3-e196-4d58-8e13-d22139202fd5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:12.818721 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d670e2d3-e196-4d58-8e13-d22139202fd5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:12.819189 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d670e2d3-e196-4d58-8e13-d22139202fd5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:12.819936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d670e2d3-e196-4d58-8e13-d22139202fd5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:12.820385 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d670e2d3-e196-4d58-8e13-d22139202fd5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:12.946608 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d670e2d3-e196-4d58-8e13-d22139202fd5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:12.955046 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d670e2d3-e196-4d58-8e13-d22139202fd5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1708 microversion: 2.1 time: 0.147195 Jun 20 18:50:12.955601 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 264/540] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:12 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1708 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:13.552956 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-642cd4ff-940d-4a9f-ac69-90106501cd96 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:13.553661 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-642cd4ff-940d-4a9f-ac69-90106501cd96 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:13.560795 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-642cd4ff-940d-4a9f-ac69-90106501cd96 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:13.561231 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-642cd4ff-940d-4a9f-ac69-90106501cd96 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:13.561970 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-642cd4ff-940d-4a9f-ac69-90106501cd96 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:13.562397 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-642cd4ff-940d-4a9f-ac69-90106501cd96 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:13.691119 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-642cd4ff-940d-4a9f-ac69-90106501cd96 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:13.700679 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-642cd4ff-940d-4a9f-ac69-90106501cd96 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:13.702461 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-642cd4ff-940d-4a9f-ac69-90106501cd96 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:13.703644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-642cd4ff-940d-4a9f-ac69-90106501cd96 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.154728 Jun 20 18:50:13.704200 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 277/541] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:13 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:13.972175 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5af3dc4c-0405-4d30-8465-254c3bac9031 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:13.972735 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5af3dc4c-0405-4d30-8465-254c3bac9031 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:13.979246 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5af3dc4c-0405-4d30-8465-254c3bac9031 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:13.979692 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5af3dc4c-0405-4d30-8465-254c3bac9031 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:13.981073 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5af3dc4c-0405-4d30-8465-254c3bac9031 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:13.981509 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5af3dc4c-0405-4d30-8465-254c3bac9031 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:14.108307 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5af3dc4c-0405-4d30-8465-254c3bac9031 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:14.116149 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5af3dc4c-0405-4d30-8465-254c3bac9031 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1708 microversion: 2.1 time: 0.147906 Jun 20 18:50:14.116704 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 265/542] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:13 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1708 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:14.721861 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-498a672f-d6ef-4c6a-899b-273d6d133f60 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:14.722466 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-498a672f-d6ef-4c6a-899b-273d6d133f60 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:14.729030 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-498a672f-d6ef-4c6a-899b-273d6d133f60 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:14.729476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-498a672f-d6ef-4c6a-899b-273d6d133f60 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:14.730230 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-498a672f-d6ef-4c6a-899b-273d6d133f60 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:14.731275 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-498a672f-d6ef-4c6a-899b-273d6d133f60 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:14.735203 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:14.857537 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-498a672f-d6ef-4c6a-899b-273d6d133f60 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:14.865415 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-498a672f-d6ef-4c6a-899b-273d6d133f60 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:14.866893 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-498a672f-d6ef-4c6a-899b-273d6d133f60 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:14.868050 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-498a672f-d6ef-4c6a-899b-273d6d133f60 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.150177 Jun 20 18:50:14.868613 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 278/543] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:14 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:15.133461 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b9ee8139-728f-4139-b862-dae2c2a3d0d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:15.134075 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b9ee8139-728f-4139-b862-dae2c2a3d0d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:15.141025 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b9ee8139-728f-4139-b862-dae2c2a3d0d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:15.141466 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b9ee8139-728f-4139-b862-dae2c2a3d0d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:15.142216 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b9ee8139-728f-4139-b862-dae2c2a3d0d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:15.142641 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b9ee8139-728f-4139-b862-dae2c2a3d0d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:15.272546 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b9ee8139-728f-4139-b862-dae2c2a3d0d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:15.281025 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b9ee8139-728f-4139-b862-dae2c2a3d0d3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1708 microversion: 2.1 time: 0.151380 Jun 20 18:50:15.281575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 266/544] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:15 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:15.885490 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fe73a708-31d7-4409-a913-da4d1100acc6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:15.886089 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fe73a708-31d7-4409-a913-da4d1100acc6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:15.893294 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fe73a708-31d7-4409-a913-da4d1100acc6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:15.893735 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fe73a708-31d7-4409-a913-da4d1100acc6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:15.894485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fe73a708-31d7-4409-a913-da4d1100acc6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:15.894909 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fe73a708-31d7-4409-a913-da4d1100acc6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:16.024306 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fe73a708-31d7-4409-a913-da4d1100acc6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:16.032989 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fe73a708-31d7-4409-a913-da4d1100acc6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:16.034497 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fe73a708-31d7-4409-a913-da4d1100acc6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:16.035672 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fe73a708-31d7-4409-a913-da4d1100acc6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.154071 Jun 20 18:50:16.036233 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 279/545] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:15 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:16.298222 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a9bffe6c-aa81-4d15-aeec-00b0efd68711 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:16.298830 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a9bffe6c-aa81-4d15-aeec-00b0efd68711 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:16.305596 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a9bffe6c-aa81-4d15-aeec-00b0efd68711 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:16.306041 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a9bffe6c-aa81-4d15-aeec-00b0efd68711 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:16.306804 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a9bffe6c-aa81-4d15-aeec-00b0efd68711 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:16.307269 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a9bffe6c-aa81-4d15-aeec-00b0efd68711 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:16.443379 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a9bffe6c-aa81-4d15-aeec-00b0efd68711 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:16.452116 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a9bffe6c-aa81-4d15-aeec-00b0efd68711 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1708 microversion: 2.1 time: 0.157723 Jun 20 18:50:16.452669 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 267/546] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:16 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1708 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:16.507145 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1759311850", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "networks": [{"uuid": "73703d53-31d3-4ad5-aeab-3950df8b9a15"}]}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:16.556584 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.network.neutron [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] validate_networks() for [('73703d53-31d3-4ad5-aeab-3950df8b9a15', None, None, None, None, None)] {{(pid=124189) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:50:17.054677 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4f30cd23-7010-4aa4-a02d-290ca23e5fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:17.055645 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-4f30cd23-7010-4aa4-a02d-290ca23e5fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:17.064444 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4f30cd23-7010-4aa4-a02d-290ca23e5fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:17.065029 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4f30cd23-7010-4aa4-a02d-290ca23e5fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:17.066010 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4f30cd23-7010-4aa4-a02d-290ca23e5fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:17.066511 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4f30cd23-7010-4aa4-a02d-290ca23e5fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:17.163607 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Flavor limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:50:17.164761 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Image limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:50:17.165382 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Flavor pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:50:17.165957 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Image pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:50:17.166525 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:50:17.184924 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:17.185620 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:17.186608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:17.189314 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:17.230998 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Getting quotas for project 98d56a21c52b49ffbc838f590fe76d29. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:50:17.235862 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Getting quotas for user 27e3a6db1a9b4c38bb8a5697ed08f8e7 and project 98d56a21c52b49ffbc838f590fe76d29. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:50:17.255621 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4f30cd23-7010-4aa4-a02d-290ca23e5fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:17.258310 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Going to run 1 instances... {{(pid=124189) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:50:17.271969 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124189) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:50:17.272378 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4f30cd23-7010-4aa4-a02d-290ca23e5fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:17.274230 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4f30cd23-7010-4aa4-a02d-290ca23e5fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:17.275915 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4f30cd23-7010-4aa4-a02d-290ca23e5fda tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.225998 Jun 20 18:50:17.290099 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 268/547] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:17 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:50:17.302265 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:17.332440 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6653a935-352d-47bb-9640-93da49cdc82b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829006 Jun 20 18:50:17.333593 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 280/548] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:50:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:50:17.343704 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9278bc98-9ca5-4fb9-b393-2396f16cbd05 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:17.344480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9278bc98-9ca5-4fb9-b393-2396f16cbd05 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:17.445026 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9278bc98-9ca5-4fb9-b393-2396f16cbd05 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:17.457295 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9278bc98-9ca5-4fb9-b393-2396f16cbd05 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1219 microversion: 2.1 time: 0.118127 Jun 20 18:50:17.463483 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 269/549] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:17 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:17.473906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-708c0a30-02fa-43a6-bce0-72a4c08f02a1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:17.474716 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-708c0a30-02fa-43a6-bce0-72a4c08f02a1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:17.482173 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-708c0a30-02fa-43a6-bce0-72a4c08f02a1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:17.487751 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-41ecd524-4a61-4b90-bed7-c660fcb2254e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Action: 'create', calling method: .version_select at 0x7f7e449f4d30>, body: {"keypair": {"name": "tempest-keypair-986286275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9wTtdfvbG5I+Cd1EpDUmjnhNsdyWKOfJmHY9VfeuFgweNqeKXXhaDNTgU/s6egWkZkcav8QgqkqeTAAW1cHoU7QIsWUdB1eNyDhHncydRXTmE+khLKTg6Tiau1J7g0Jg=="}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:17.492296 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-708c0a30-02fa-43a6-bce0-72a4c08f02a1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:17.493590 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-708c0a30-02fa-43a6-bce0-72a4c08f02a1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:17.494185 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-708c0a30-02fa-43a6-bce0-72a4c08f02a1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:17.579132 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-41ecd524-4a61-4b90-bed7-c660fcb2254e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Getting quotas for project 7b4a919be31b4c74a3197d98ecec7fde. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:50:17.589226 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-41ecd524-4a61-4b90-bed7-c660fcb2254e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Getting quotas for user 31fed190cac24d1b8326425f737e220b and project 7b4a919be31b4c74a3197d98ecec7fde. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:50:17.650181 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-41ecd524-4a61-4b90-bed7-c660fcb2254e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.166330 Jun 20 18:50:17.651646 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 270/550] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jun 20 18:50:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:50:17.766578 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-39baea23-95ce-4474-90f1-0c0f6f17341b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:17.767423 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-39baea23-95ce-4474-90f1-0c0f6f17341b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:17.778727 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-39baea23-95ce-4474-90f1-0c0f6f17341b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:17.779329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-39baea23-95ce-4474-90f1-0c0f6f17341b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:17.780364 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-39baea23-95ce-4474-90f1-0c0f6f17341b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:17.781044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-39baea23-95ce-4474-90f1-0c0f6f17341b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:17.927653 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-708c0a30-02fa-43a6-bce0-72a4c08f02a1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:17.940608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-708c0a30-02fa-43a6-bce0-72a4c08f02a1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1708 microversion: 2.1 time: 0.469780 Jun 20 18:50:17.942244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 281/551] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:17 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1708 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:18.044511 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-39baea23-95ce-4474-90f1-0c0f6f17341b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:18.055522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-39baea23-95ce-4474-90f1-0c0f6f17341b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1593 microversion: 2.1 time: 0.294056 Jun 20 18:50:18.056098 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 271/552] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:17 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1593 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:18.297554 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c274a2d7-db64-4653-b697-b0974deecbcc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:18.298304 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c274a2d7-db64-4653-b697-b0974deecbcc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:18.309873 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c274a2d7-db64-4653-b697-b0974deecbcc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:18.310332 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c274a2d7-db64-4653-b697-b0974deecbcc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:18.311129 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c274a2d7-db64-4653-b697-b0974deecbcc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:18.311557 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c274a2d7-db64-4653-b697-b0974deecbcc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:18.483348 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9df6e782-511d-416d-8b25-b39ae1e0c60c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:18.483964 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9df6e782-511d-416d-8b25-b39ae1e0c60c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:18.500169 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9df6e782-511d-416d-8b25-b39ae1e0c60c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:18.500873 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9df6e782-511d-416d-8b25-b39ae1e0c60c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:18.501922 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9df6e782-511d-416d-8b25-b39ae1e0c60c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:18.502566 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9df6e782-511d-416d-8b25-b39ae1e0c60c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:18.576983 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9df6e782-511d-416d-8b25-b39ae1e0c60c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:18.584740 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9df6e782-511d-416d-8b25-b39ae1e0c60c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1271 microversion: 2.1 time: 0.114928 Jun 20 18:50:18.585351 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 272/553] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:18 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:18.709093 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c274a2d7-db64-4653-b697-b0974deecbcc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:18.720629 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c274a2d7-db64-4653-b697-b0974deecbcc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:18.724281 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c274a2d7-db64-4653-b697-b0974deecbcc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:18.725865 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c274a2d7-db64-4653-b697-b0974deecbcc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.432223 Jun 20 18:50:18.726936 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 282/554] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:18 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:18.960348 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-12b2fd04-6cb2-48b1-8e95-c4fb482916c1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:18.960959 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-12b2fd04-6cb2-48b1-8e95-c4fb482916c1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:18.993013 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-12b2fd04-6cb2-48b1-8e95-c4fb482916c1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:18.993907 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-12b2fd04-6cb2-48b1-8e95-c4fb482916c1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:18.997265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-12b2fd04-6cb2-48b1-8e95-c4fb482916c1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:18.999027 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-12b2fd04-6cb2-48b1-8e95-c4fb482916c1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:19.255868 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-12b2fd04-6cb2-48b1-8e95-c4fb482916c1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:19.267995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-12b2fd04-6cb2-48b1-8e95-c4fb482916c1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1708 microversion: 2.1 time: 0.312391 Jun 20 18:50:19.280765 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 273/555] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:18 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1708 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:19.601866 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-44be8ce9-794a-4848-9188-08fe15f3dfc6 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:19.603205 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-44be8ce9-794a-4848-9188-08fe15f3dfc6 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:19.616976 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44be8ce9-794a-4848-9188-08fe15f3dfc6 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:19.617758 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44be8ce9-794a-4848-9188-08fe15f3dfc6 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:19.618878 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44be8ce9-794a-4848-9188-08fe15f3dfc6 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:19.621842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44be8ce9-794a-4848-9188-08fe15f3dfc6 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:19.761242 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b3426149-1a09-44ff-885e-9b4b288ea5c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:19.764633 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b3426149-1a09-44ff-885e-9b4b288ea5c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:19.768463 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-44be8ce9-794a-4848-9188-08fe15f3dfc6 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:19.778708 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b3426149-1a09-44ff-885e-9b4b288ea5c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:19.779571 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b3426149-1a09-44ff-885e-9b4b288ea5c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:19.780615 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b3426149-1a09-44ff-885e-9b4b288ea5c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:19.781406 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b3426149-1a09-44ff-885e-9b4b288ea5c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:19.783746 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-44be8ce9-794a-4848-9188-08fe15f3dfc6 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1271 microversion: 2.1 time: 0.185926 Jun 20 18:50:19.789137 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 283/556] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:19 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:20.285962 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-333596c2-e950-4645-9f15-0567fc6f75e5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:20.286683 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-333596c2-e950-4645-9f15-0567fc6f75e5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:20.307736 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-333596c2-e950-4645-9f15-0567fc6f75e5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:20.308372 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-333596c2-e950-4645-9f15-0567fc6f75e5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:20.309731 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-333596c2-e950-4645-9f15-0567fc6f75e5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:20.310365 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-333596c2-e950-4645-9f15-0567fc6f75e5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:20.314181 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b3426149-1a09-44ff-885e-9b4b288ea5c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:20.327475 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b3426149-1a09-44ff-885e-9b4b288ea5c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:20.330759 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b3426149-1a09-44ff-885e-9b4b288ea5c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:20.332297 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b3426149-1a09-44ff-885e-9b4b288ea5c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.576928 Jun 20 18:50:20.333513 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 274/557] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:19 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:20.438067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2076392394", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "619214b4-923a-4887-a5d4-59de0868e3a9"}], "security_groups": [{"name": "tempest-securitygroup--630298320"}], "key_name": "tempest-keypair-986286275", "user_data": "}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:20.572194 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.network.neutron [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] validate_networks() for [('619214b4-923a-4887-a5d4-59de0868e3a9', None, None, None, None, None)] {{(pid=124190) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:50:20.680777 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-333596c2-e950-4645-9f15-0567fc6f75e5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:20.695078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-333596c2-e950-4645-9f15-0567fc6f75e5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1712 microversion: 2.1 time: 0.410587 Jun 20 18:50:20.705638 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 284/558] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:20 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1712 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:20.805230 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-38dbbce2-afb2-4dd9-b9d3-bf1ab3f92afd tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:20.805941 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-38dbbce2-afb2-4dd9-b9d3-bf1ab3f92afd tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:20.816778 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-38dbbce2-afb2-4dd9-b9d3-bf1ab3f92afd tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:20.817574 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-38dbbce2-afb2-4dd9-b9d3-bf1ab3f92afd tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:20.818599 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-38dbbce2-afb2-4dd9-b9d3-bf1ab3f92afd tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:20.819424 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-38dbbce2-afb2-4dd9-b9d3-bf1ab3f92afd tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:20.971305 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-38dbbce2-afb2-4dd9-b9d3-bf1ab3f92afd tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:20.990554 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-38dbbce2-afb2-4dd9-b9d3-bf1ab3f92afd tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1277 microversion: 2.1 time: 0.178227 Jun 20 18:50:21.003368 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 285/559] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:20 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:21.159769 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Flavor limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:50:21.160983 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Image limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:50:21.161473 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Flavor pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:50:21.161860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Image pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:50:21.162269 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:50:21.172336 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:21.172782 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:21.173808 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:21.174384 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:21.192390 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Getting quotas for project 7b4a919be31b4c74a3197d98ecec7fde. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:50:21.196626 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Getting quotas for user 31fed190cac24d1b8326425f737e220b and project 7b4a919be31b4c74a3197d98ecec7fde. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:50:21.209748 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Going to run 1 instances... {{(pid=124190) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:50:21.212364 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124190) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:50:21.284324 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c4da8650-a8dc-46d4-8887-abd14470b5e4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.851181 Jun 20 18:50:21.294426 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 275/560] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:50:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 18:50:21.296685 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0bbef600-cf8e-4cfa-9344-00d8c2ac01d4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:21.297372 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0bbef600-cf8e-4cfa-9344-00d8c2ac01d4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:21.352040 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8450dc48-c403-476b-9c2a-c1d9dbaace5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:21.352927 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8450dc48-c403-476b-9c2a-c1d9dbaace5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:21.364096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8450dc48-c403-476b-9c2a-c1d9dbaace5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:21.366173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8450dc48-c403-476b-9c2a-c1d9dbaace5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:21.368423 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8450dc48-c403-476b-9c2a-c1d9dbaace5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:21.371823 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8450dc48-c403-476b-9c2a-c1d9dbaace5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:21.423221 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0bbef600-cf8e-4cfa-9344-00d8c2ac01d4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:21.430100 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0bbef600-cf8e-4cfa-9344-00d8c2ac01d4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1245 microversion: 2.1 time: 0.137369 Jun 20 18:50:21.441299 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 286/561] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:21 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1245 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:21.539139 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-8fe3d899-fcee-4ec9-bd4d-572a955c81f6 req-41648929-7f79-4ddc-8c57-38644c630b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a42434-2efd-4f8e-b3fb-e77f0e99f072", "tag": "96708947-b2a6-41f9-8eb6-1a4bc89a1294"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:21.554810 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-8fe3d899-fcee-4ec9-bd4d-572a955c81f6 req-41648929-7f79-4ddc-8c57-38644c630b38 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:21.564111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-8fe3d899-fcee-4ec9-bd4d-572a955c81f6 req-41648929-7f79-4ddc-8c57-38644c630b38 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:21.600938 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-8fe3d899-fcee-4ec9-bd4d-572a955c81f6 req-41648929-7f79-4ddc-8c57-38644c630b38 service nova] Creating event network-changed:96708947-b2a6-41f9-8eb6-1a4bc89a1294 for instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 on hv-cinder-83697 Jun 20 18:50:21.616651 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-8fe3d899-fcee-4ec9-bd4d-572a955c81f6 req-41648929-7f79-4ddc-8c57-38644c630b38 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081268 Jun 20 18:50:21.631760 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 287/562] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:50:21.909375 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8450dc48-c403-476b-9c2a-c1d9dbaace5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:21.938271 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8450dc48-c403-476b-9c2a-c1d9dbaace5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:21.952222 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8450dc48-c403-476b-9c2a-c1d9dbaace5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:21.963474 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8450dc48-c403-476b-9c2a-c1d9dbaace5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.614098 Jun 20 18:50:21.965853 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 276/563] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:21 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:50:22.010380 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e54cefb5-1abc-4b11-b84b-70fdd95d0b91 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:22.012332 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e54cefb5-1abc-4b11-b84b-70fdd95d0b91 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:22.023261 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e54cefb5-1abc-4b11-b84b-70fdd95d0b91 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:22.026680 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e54cefb5-1abc-4b11-b84b-70fdd95d0b91 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:22.028282 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e54cefb5-1abc-4b11-b84b-70fdd95d0b91 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:22.028726 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e54cefb5-1abc-4b11-b84b-70fdd95d0b91 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:22.449503 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a3d49321-7d53-491f-8d32-df0698a46d14 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:22.450097 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a3d49321-7d53-491f-8d32-df0698a46d14 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:22.457294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a3d49321-7d53-491f-8d32-df0698a46d14 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:22.458073 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a3d49321-7d53-491f-8d32-df0698a46d14 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:22.459125 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a3d49321-7d53-491f-8d32-df0698a46d14 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:22.461331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a3d49321-7d53-491f-8d32-df0698a46d14 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:22.568478 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e54cefb5-1abc-4b11-b84b-70fdd95d0b91 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:22.594514 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e54cefb5-1abc-4b11-b84b-70fdd95d0b91 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1319 microversion: 2.1 time: 0.588203 Jun 20 18:50:22.596297 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 288/564] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:22 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1319 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:22.638839 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a3d49321-7d53-491f-8d32-df0698a46d14 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:22.648617 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a3d49321-7d53-491f-8d32-df0698a46d14 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1241 microversion: 2.1 time: 0.204207 Jun 20 18:50:22.651060 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 277/565] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:22 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1241 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:22.984403 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-45db9ae7-c9e3-4689-97ee-a74f21f89285 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:22.985102 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-45db9ae7-c9e3-4689-97ee-a74f21f89285 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:22.993998 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-45db9ae7-c9e3-4689-97ee-a74f21f89285 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:22.994787 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-45db9ae7-c9e3-4689-97ee-a74f21f89285 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:22.996319 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-45db9ae7-c9e3-4689-97ee-a74f21f89285 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:22.996938 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-45db9ae7-c9e3-4689-97ee-a74f21f89285 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:23.397450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-45db9ae7-c9e3-4689-97ee-a74f21f89285 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:23.424770 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-45db9ae7-c9e3-4689-97ee-a74f21f89285 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:23.432650 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-45db9ae7-c9e3-4689-97ee-a74f21f89285 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:23.438509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-45db9ae7-c9e3-4689-97ee-a74f21f89285 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.455177 Jun 20 18:50:23.440610 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 289/566] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:22 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:23.613118 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-45f60a24-4572-4491-87bc-3d9835cf902a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:23.613118 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-45f60a24-4572-4491-87bc-3d9835cf902a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:23.626854 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-45f60a24-4572-4491-87bc-3d9835cf902a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:23.627585 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-45f60a24-4572-4491-87bc-3d9835cf902a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:23.628902 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-45f60a24-4572-4491-87bc-3d9835cf902a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:23.630069 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-45f60a24-4572-4491-87bc-3d9835cf902a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:23.670132 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b44d42ad-660b-419f-a397-5b905a4f50c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:23.670843 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b44d42ad-660b-419f-a397-5b905a4f50c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:23.682705 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b44d42ad-660b-419f-a397-5b905a4f50c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:23.683738 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b44d42ad-660b-419f-a397-5b905a4f50c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:23.695323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b44d42ad-660b-419f-a397-5b905a4f50c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:23.696279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b44d42ad-660b-419f-a397-5b905a4f50c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:23.847245 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b44d42ad-660b-419f-a397-5b905a4f50c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:23.867182 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b44d42ad-660b-419f-a397-5b905a4f50c4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1303 microversion: 2.1 time: 0.199838 Jun 20 18:50:23.873244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 290/567] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:23 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1303 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:23.882896 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-a2104607-737a-4916-b061-e75f337e1f8c req-26a74c90-7e61-46da-a1fc-ccbdc856e2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a4746c-b747-44dc-a25d-dc1ab9843931", "tag": "b5c7bf4a-8f36-4140-a240-1ef39607c1c5"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:23.892149 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-45f60a24-4572-4491-87bc-3d9835cf902a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:23.896096 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-a2104607-737a-4916-b061-e75f337e1f8c req-26a74c90-7e61-46da-a1fc-ccbdc856e2a3 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:23.897508 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-a2104607-737a-4916-b061-e75f337e1f8c req-26a74c90-7e61-46da-a1fc-ccbdc856e2a3 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:23.901818 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-45f60a24-4572-4491-87bc-3d9835cf902a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1319 microversion: 2.1 time: 0.293189 Jun 20 18:50:23.912337 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-a2104607-737a-4916-b061-e75f337e1f8c req-26a74c90-7e61-46da-a1fc-ccbdc856e2a3 service nova] Creating event network-changed:b5c7bf4a-8f36-4140-a240-1ef39607c1c5 for instance 96a4746c-b747-44dc-a25d-dc1ab9843931 on hv-cinder-83697 Jun 20 18:50:23.914310 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 278/568] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:23 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:23.926757 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-a2104607-737a-4916-b061-e75f337e1f8c req-26a74c90-7e61-46da-a1fc-ccbdc856e2a3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049878 Jun 20 18:50:23.927563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 291/569] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:50:24.053375 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f20f8655-71e5-45fe-afe9-1f768fe2c5af tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-610668756"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:24.053904 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f20f8655-71e5-45fe-afe9-1f768fe2c5af tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:24.063560 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f20f8655-71e5-45fe-afe9-1f768fe2c5af tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:24.064240 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f20f8655-71e5-45fe-afe9-1f768fe2c5af tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:24.065177 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f20f8655-71e5-45fe-afe9-1f768fe2c5af tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:24.068347 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f20f8655-71e5-45fe-afe9-1f768fe2c5af tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:24.364023 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.network.security_group_api [None req-f20f8655-71e5-45fe-afe9-1f768fe2c5af tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Adding security group 1de9522c-dfaa-4f91-ae00-497c9ce282a6 to port 96708947-b2a6-41f9-8eb6-1a4bc89a1294 Jun 20 18:50:24.459182 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a269e8d7-19fd-4840-aa4c-a67938502141 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:24.460911 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a269e8d7-19fd-4840-aa4c-a67938502141 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:24.468877 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a269e8d7-19fd-4840-aa4c-a67938502141 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:24.469691 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a269e8d7-19fd-4840-aa4c-a67938502141 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:24.470860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a269e8d7-19fd-4840-aa4c-a67938502141 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:24.471753 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a269e8d7-19fd-4840-aa4c-a67938502141 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:24.624264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a269e8d7-19fd-4840-aa4c-a67938502141 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:24.634653 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a269e8d7-19fd-4840-aa4c-a67938502141 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:24.636636 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a269e8d7-19fd-4840-aa4c-a67938502141 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:24.638153 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a269e8d7-19fd-4840-aa4c-a67938502141 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.183250 Jun 20 18:50:24.638705 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 292/570] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:24 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:50:24.890359 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f723c907-e967-40ea-bf0b-23829e787e5c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:24.891367 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f723c907-e967-40ea-bf0b-23829e787e5c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:24.898638 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f723c907-e967-40ea-bf0b-23829e787e5c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:24.899404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f723c907-e967-40ea-bf0b-23829e787e5c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:24.900322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f723c907-e967-40ea-bf0b-23829e787e5c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:24.900860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f723c907-e967-40ea-bf0b-23829e787e5c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:24.923155 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f20f8655-71e5-45fe-afe9-1f768fe2c5af tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "POST /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/action" status: 202 len: 0 microversion: 2.1 time: 0.869792 Jun 20 18:50:24.926828 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 279/571] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jun 20 18:50:24 2022] POST /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/action => generated 0 bytes in 875 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:50:24.928875 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-af74fc10-f753-451b-ac4c-bf3e28a03189 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:24.929479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-af74fc10-f753-451b-ac4c-bf3e28a03189 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:24.938651 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-af74fc10-f753-451b-ac4c-bf3e28a03189 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:24.939128 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-af74fc10-f753-451b-ac4c-bf3e28a03189 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:24.940743 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-af74fc10-f753-451b-ac4c-bf3e28a03189 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:24.941527 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-af74fc10-f753-451b-ac4c-bf3e28a03189 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:25.185496 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-af74fc10-f753-451b-ac4c-bf3e28a03189 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:25.188838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f723c907-e967-40ea-bf0b-23829e787e5c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:25.199992 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-af74fc10-f753-451b-ac4c-bf3e28a03189 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1319 microversion: 2.1 time: 0.274649 Jun 20 18:50:25.200565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f723c907-e967-40ea-bf0b-23829e787e5c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1370 microversion: 2.1 time: 0.314658 Jun 20 18:50:25.200795 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 280/572] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:24 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:25.201853 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 293/573] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:24 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1370 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:25.207350 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-f37c144e-b4e3-4a3b-ba89-82ca79047c79 req-72e2b780-572c-4ae8-a0d9-0b929c9bab84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a42434-2efd-4f8e-b3fb-e77f0e99f072", "tag": "96708947-b2a6-41f9-8eb6-1a4bc89a1294"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:25.218976 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e65f5b6c-184e-4192-ad91-1a04af66df4f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:25.218976 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e65f5b6c-184e-4192-ad91-1a04af66df4f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:25.222808 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e65f5b6c-184e-4192-ad91-1a04af66df4f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:25.223725 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e65f5b6c-184e-4192-ad91-1a04af66df4f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:25.224499 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e65f5b6c-184e-4192-ad91-1a04af66df4f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:25.224930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e65f5b6c-184e-4192-ad91-1a04af66df4f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:25.227784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-f37c144e-b4e3-4a3b-ba89-82ca79047c79 req-72e2b780-572c-4ae8-a0d9-0b929c9bab84 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:25.228460 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-f37c144e-b4e3-4a3b-ba89-82ca79047c79 req-72e2b780-572c-4ae8-a0d9-0b929c9bab84 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:25.241866 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-f37c144e-b4e3-4a3b-ba89-82ca79047c79 req-72e2b780-572c-4ae8-a0d9-0b929c9bab84 service nova] Creating event network-changed:96708947-b2a6-41f9-8eb6-1a4bc89a1294 for instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 on hv-cinder-83697 Jun 20 18:50:25.247542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-f37c144e-b4e3-4a3b-ba89-82ca79047c79 req-72e2b780-572c-4ae8-a0d9-0b929c9bab84 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044326 Jun 20 18:50:25.248379 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 294/574] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:50:25.255286 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:25.453224 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e65f5b6c-184e-4192-ad91-1a04af66df4f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:25.466283 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e65f5b6c-184e-4192-ad91-1a04af66df4f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1757 microversion: 2.1 time: 0.254958 Jun 20 18:50:25.467189 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 281/575] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:25 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1757 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:25.658732 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-292a1173-9d66-403c-ae02-53d6801562fb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:25.660160 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-292a1173-9d66-403c-ae02-53d6801562fb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:25.669499 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-292a1173-9d66-403c-ae02-53d6801562fb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:25.670829 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-292a1173-9d66-403c-ae02-53d6801562fb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:25.671891 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-292a1173-9d66-403c-ae02-53d6801562fb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:25.672591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-292a1173-9d66-403c-ae02-53d6801562fb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:25.864127 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-292a1173-9d66-403c-ae02-53d6801562fb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:25.875392 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-292a1173-9d66-403c-ae02-53d6801562fb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:25.877308 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-292a1173-9d66-403c-ae02-53d6801562fb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:25.878567 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-292a1173-9d66-403c-ae02-53d6801562fb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.225206 Jun 20 18:50:25.879213 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 295/576] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:25 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:26.218008 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ab507be9-9b47-4648-915e-5f41494f6381 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:26.219321 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ab507be9-9b47-4648-915e-5f41494f6381 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:26.225750 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-911926b2-b943-4be2-8951-014490077092 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:26.226501 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ab507be9-9b47-4648-915e-5f41494f6381 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:26.226634 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-911926b2-b943-4be2-8951-014490077092 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:26.226980 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ab507be9-9b47-4648-915e-5f41494f6381 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:26.227942 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ab507be9-9b47-4648-915e-5f41494f6381 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:26.228376 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ab507be9-9b47-4648-915e-5f41494f6381 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:26.237566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-911926b2-b943-4be2-8951-014490077092 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:26.238191 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-911926b2-b943-4be2-8951-014490077092 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:26.239243 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-911926b2-b943-4be2-8951-014490077092 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:26.242655 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-911926b2-b943-4be2-8951-014490077092 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:26.415472 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-911926b2-b943-4be2-8951-014490077092 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:26.423873 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-911926b2-b943-4be2-8951-014490077092 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1370 microversion: 2.1 time: 0.202208 Jun 20 18:50:26.425807 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 296/577] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:26 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:26.429741 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ab507be9-9b47-4648-915e-5f41494f6381 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:26.438229 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ab507be9-9b47-4648-915e-5f41494f6381 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1319 microversion: 2.1 time: 0.224897 Jun 20 18:50:26.438856 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 282/578] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:26 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:26.897379 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8a2c3715-2452-49e9-bf8c-c69659aaa255 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:26.897982 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8a2c3715-2452-49e9-bf8c-c69659aaa255 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:26.907378 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a2c3715-2452-49e9-bf8c-c69659aaa255 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:26.908089 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a2c3715-2452-49e9-bf8c-c69659aaa255 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:26.909151 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a2c3715-2452-49e9-bf8c-c69659aaa255 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:26.909806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a2c3715-2452-49e9-bf8c-c69659aaa255 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:27.054632 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8a2c3715-2452-49e9-bf8c-c69659aaa255 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:27.064234 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8a2c3715-2452-49e9-bf8c-c69659aaa255 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:27.066036 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8a2c3715-2452-49e9-bf8c-c69659aaa255 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:27.067359 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8a2c3715-2452-49e9-bf8c-c69659aaa255 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.173892 Jun 20 18:50:27.068171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 297/579] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:26 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:27.440351 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0a175498-a868-4401-8659-abc5d27b5ae5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:27.441672 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0a175498-a868-4401-8659-abc5d27b5ae5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:27.448336 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a175498-a868-4401-8659-abc5d27b5ae5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:27.451027 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a175498-a868-4401-8659-abc5d27b5ae5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:27.451930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a175498-a868-4401-8659-abc5d27b5ae5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:27.452536 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a175498-a868-4401-8659-abc5d27b5ae5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:27.457490 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1fb6bf85-0dce-442a-8669-58921b828223 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:27.459128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1fb6bf85-0dce-442a-8669-58921b828223 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:27.462273 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:27.467557 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1fb6bf85-0dce-442a-8669-58921b828223 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:27.468006 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1fb6bf85-0dce-442a-8669-58921b828223 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:27.468762 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1fb6bf85-0dce-442a-8669-58921b828223 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:27.469366 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1fb6bf85-0dce-442a-8669-58921b828223 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:27.486055 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:27.642288 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0a175498-a868-4401-8659-abc5d27b5ae5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:27.652699 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0a175498-a868-4401-8659-abc5d27b5ae5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1370 microversion: 2.1 time: 0.215611 Jun 20 18:50:27.662476 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 283/580] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:27 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:27.766668 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1fb6bf85-0dce-442a-8669-58921b828223 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:27.788892 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1fb6bf85-0dce-442a-8669-58921b828223 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1319 microversion: 2.1 time: 0.336052 Jun 20 18:50:27.807115 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 298/581] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:27 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:28.085951 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b06b5253-3695-4c81-8bb9-69f4e807c2b3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:28.086564 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b06b5253-3695-4c81-8bb9-69f4e807c2b3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:28.094524 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b06b5253-3695-4c81-8bb9-69f4e807c2b3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:28.094900 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b06b5253-3695-4c81-8bb9-69f4e807c2b3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:28.095718 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b06b5253-3695-4c81-8bb9-69f4e807c2b3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:28.096163 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b06b5253-3695-4c81-8bb9-69f4e807c2b3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:28.497408 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-43bd6b08-6c72-43b9-b0d7-555dae08e011 req-4f02c51e-ae5b-42af-a932-44ab060acd3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7fdf69c-2b2a-4801-82ca-54805176159b", "tag": "cbfc3863-3fe2-440b-acc3-803dbc08a337"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:28.502610 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b06b5253-3695-4c81-8bb9-69f4e807c2b3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:28.516589 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b06b5253-3695-4c81-8bb9-69f4e807c2b3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:28.519166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b06b5253-3695-4c81-8bb9-69f4e807c2b3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:28.519608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-43bd6b08-6c72-43b9-b0d7-555dae08e011 req-4f02c51e-ae5b-42af-a932-44ab060acd3a service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:28.520073 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-43bd6b08-6c72-43b9-b0d7-555dae08e011 req-4f02c51e-ae5b-42af-a932-44ab060acd3a service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:28.520965 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b06b5253-3695-4c81-8bb9-69f4e807c2b3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.438966 Jun 20 18:50:28.532984 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 284/582] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:28 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:28.567326 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-43bd6b08-6c72-43b9-b0d7-555dae08e011 req-4f02c51e-ae5b-42af-a932-44ab060acd3a service nova] Creating event network-changed:cbfc3863-3fe2-440b-acc3-803dbc08a337 for instance f7fdf69c-2b2a-4801-82ca-54805176159b on hv-cinder-83697 Jun 20 18:50:28.582419 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-43bd6b08-6c72-43b9-b0d7-555dae08e011 req-4f02c51e-ae5b-42af-a932-44ab060acd3a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096082 Jun 20 18:50:28.583050 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 299/583] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:50:28.670561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-35e84142-a1eb-4497-b008-693dce14dae2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:28.671201 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-35e84142-a1eb-4497-b008-693dce14dae2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:28.682874 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35e84142-a1eb-4497-b008-693dce14dae2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:28.683419 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35e84142-a1eb-4497-b008-693dce14dae2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:28.684198 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35e84142-a1eb-4497-b008-693dce14dae2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:28.684637 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35e84142-a1eb-4497-b008-693dce14dae2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:28.817830 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-95f53065-97f8-4cae-9fe0-2d938af77884 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:28.818667 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-95f53065-97f8-4cae-9fe0-2d938af77884 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:28.837646 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-95f53065-97f8-4cae-9fe0-2d938af77884 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:28.838098 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-95f53065-97f8-4cae-9fe0-2d938af77884 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:28.841731 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-95f53065-97f8-4cae-9fe0-2d938af77884 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:28.841731 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-95f53065-97f8-4cae-9fe0-2d938af77884 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:28.954077 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-35e84142-a1eb-4497-b008-693dce14dae2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:28.966740 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-35e84142-a1eb-4497-b008-693dce14dae2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1370 microversion: 2.1 time: 0.300812 Jun 20 18:50:28.967358 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 285/584] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:28 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1370 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:29.150017 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-95f53065-97f8-4cae-9fe0-2d938af77884 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:29.158109 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-95f53065-97f8-4cae-9fe0-2d938af77884 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1319 microversion: 2.1 time: 0.344453 Jun 20 18:50:29.158690 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 300/585] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:28 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:29.539953 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ffee6179-c355-4174-a71a-b14cf3e45da7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:29.541207 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ffee6179-c355-4174-a71a-b14cf3e45da7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:29.547994 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ffee6179-c355-4174-a71a-b14cf3e45da7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:29.548448 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ffee6179-c355-4174-a71a-b14cf3e45da7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:29.549218 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ffee6179-c355-4174-a71a-b14cf3e45da7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:29.549655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ffee6179-c355-4174-a71a-b14cf3e45da7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:29.717547 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ffee6179-c355-4174-a71a-b14cf3e45da7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:29.726501 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ffee6179-c355-4174-a71a-b14cf3e45da7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:29.728151 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ffee6179-c355-4174-a71a-b14cf3e45da7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:29.729609 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ffee6179-c355-4174-a71a-b14cf3e45da7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.194045 Jun 20 18:50:29.730242 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 286/586] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:29 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:29.983919 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5473b24d-ddc0-4529-bc8b-99de751e219d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:29.985384 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5473b24d-ddc0-4529-bc8b-99de751e219d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:29.992574 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5473b24d-ddc0-4529-bc8b-99de751e219d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:29.993141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5473b24d-ddc0-4529-bc8b-99de751e219d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:29.993972 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5473b24d-ddc0-4529-bc8b-99de751e219d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:29.994406 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5473b24d-ddc0-4529-bc8b-99de751e219d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:30.146111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5473b24d-ddc0-4529-bc8b-99de751e219d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:30.154652 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5473b24d-ddc0-4529-bc8b-99de751e219d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1370 microversion: 2.1 time: 0.174735 Jun 20 18:50:30.155834 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 301/587] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:29 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:30.175275 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e891217e-1fcf-4641-91cb-8a43d709bdae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:30.176151 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e891217e-1fcf-4641-91cb-8a43d709bdae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:30.179138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:30.184365 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e891217e-1fcf-4641-91cb-8a43d709bdae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:30.184809 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e891217e-1fcf-4641-91cb-8a43d709bdae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:30.185770 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e891217e-1fcf-4641-91cb-8a43d709bdae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:30.186204 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e891217e-1fcf-4641-91cb-8a43d709bdae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:30.329838 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e891217e-1fcf-4641-91cb-8a43d709bdae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:30.337984 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e891217e-1fcf-4641-91cb-8a43d709bdae tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1319 microversion: 2.1 time: 0.166465 Jun 20 18:50:30.338760 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 287/588] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:30 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:30.748338 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7580ff2e-792f-48e2-a090-11398d8f54e0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:30.748937 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7580ff2e-792f-48e2-a090-11398d8f54e0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:30.754938 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7580ff2e-792f-48e2-a090-11398d8f54e0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:30.755399 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7580ff2e-792f-48e2-a090-11398d8f54e0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:30.756147 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7580ff2e-792f-48e2-a090-11398d8f54e0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:30.756575 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7580ff2e-792f-48e2-a090-11398d8f54e0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:30.881993 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7580ff2e-792f-48e2-a090-11398d8f54e0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:30.890324 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7580ff2e-792f-48e2-a090-11398d8f54e0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:30.891880 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7580ff2e-792f-48e2-a090-11398d8f54e0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:30.893017 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7580ff2e-792f-48e2-a090-11398d8f54e0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.149101 Jun 20 18:50:30.893575 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 302/589] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:30 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:31.172266 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-367ca93c-bae0-4abb-a66a-63d857842b56 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:31.172878 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-367ca93c-bae0-4abb-a66a-63d857842b56 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:31.179659 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-367ca93c-bae0-4abb-a66a-63d857842b56 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:31.180102 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-367ca93c-bae0-4abb-a66a-63d857842b56 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:31.180868 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-367ca93c-bae0-4abb-a66a-63d857842b56 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:31.181331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-367ca93c-bae0-4abb-a66a-63d857842b56 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:31.181763 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:31.205245 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=12 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:31.313099 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-367ca93c-bae0-4abb-a66a-63d857842b56 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:31.322110 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-367ca93c-bae0-4abb-a66a-63d857842b56 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1370 microversion: 2.1 time: 0.154267 Jun 20 18:50:31.324200 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-2639371f-95fe-4ff0-a8ad-6bd33c31419e req-b0b881f7-0dea-4eae-aece-e263d57ffb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a4746c-b747-44dc-a25d-dc1ab9843931", "name": "network-vif-plugged", "status": "completed", "tag": "b5c7bf4a-8f36-4140-a240-1ef39607c1c5"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:31.332053 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 288/590] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:31 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:31.335118 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-2639371f-95fe-4ff0-a8ad-6bd33c31419e req-b0b881f7-0dea-4eae-aece-e263d57ffb8e service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:31.335865 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-2639371f-95fe-4ff0-a8ad-6bd33c31419e req-b0b881f7-0dea-4eae-aece-e263d57ffb8e service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:31.347708 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-2639371f-95fe-4ff0-a8ad-6bd33c31419e req-b0b881f7-0dea-4eae-aece-e263d57ffb8e service nova] Creating event network-vif-plugged:b5c7bf4a-8f36-4140-a240-1ef39607c1c5 for instance 96a4746c-b747-44dc-a25d-dc1ab9843931 on hv-cinder-83697 Jun 20 18:50:31.352695 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-2639371f-95fe-4ff0-a8ad-6bd33c31419e req-b0b881f7-0dea-4eae-aece-e263d57ffb8e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033653 Jun 20 18:50:31.353280 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 303/591] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:50:31.357958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5cf32fa3-4301-4900-8ad2-7380c169c704 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:31.358889 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5cf32fa3-4301-4900-8ad2-7380c169c704 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:31.365159 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5cf32fa3-4301-4900-8ad2-7380c169c704 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:31.365680 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5cf32fa3-4301-4900-8ad2-7380c169c704 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:31.366507 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5cf32fa3-4301-4900-8ad2-7380c169c704 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:31.367047 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5cf32fa3-4301-4900-8ad2-7380c169c704 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:31.497079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5cf32fa3-4301-4900-8ad2-7380c169c704 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:31.504144 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5cf32fa3-4301-4900-8ad2-7380c169c704 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1319 microversion: 2.1 time: 0.150442 Jun 20 18:50:31.504701 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 289/592] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:31 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:31.912150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5a5e7c7e-5610-4829-8ebd-8288889a380c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:31.913068 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5a5e7c7e-5610-4829-8ebd-8288889a380c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:31.915054 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=8 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:31.921186 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5a5e7c7e-5610-4829-8ebd-8288889a380c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:31.921626 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5a5e7c7e-5610-4829-8ebd-8288889a380c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:31.922374 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5a5e7c7e-5610-4829-8ebd-8288889a380c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:31.922798 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5a5e7c7e-5610-4829-8ebd-8288889a380c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:32.050728 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5a5e7c7e-5610-4829-8ebd-8288889a380c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:32.059113 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5a5e7c7e-5610-4829-8ebd-8288889a380c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:32.060606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5a5e7c7e-5610-4829-8ebd-8288889a380c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:32.061739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5a5e7c7e-5610-4829-8ebd-8288889a380c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.153816 Jun 20 18:50:32.062287 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 304/593] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:31 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:32.339643 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-de116a58-ec47-446a-ab45-2eb18c0255e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:32.340171 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-de116a58-ec47-446a-ab45-2eb18c0255e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:32.346586 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de116a58-ec47-446a-ab45-2eb18c0255e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:32.347068 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de116a58-ec47-446a-ab45-2eb18c0255e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:32.347826 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de116a58-ec47-446a-ab45-2eb18c0255e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:32.348257 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de116a58-ec47-446a-ab45-2eb18c0255e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:32.472518 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-de116a58-ec47-446a-ab45-2eb18c0255e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:32.480409 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-de116a58-ec47-446a-ab45-2eb18c0255e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1370 microversion: 2.1 time: 0.144258 Jun 20 18:50:32.480967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 290/594] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:32 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:32.521085 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-83ec468a-8878-449b-af03-f41e252eaa80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:32.521724 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-83ec468a-8878-449b-af03-f41e252eaa80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:32.528177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-83ec468a-8878-449b-af03-f41e252eaa80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:32.528625 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-83ec468a-8878-449b-af03-f41e252eaa80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:32.529382 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-83ec468a-8878-449b-af03-f41e252eaa80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:32.529820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-83ec468a-8878-449b-af03-f41e252eaa80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:32.655457 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-83ec468a-8878-449b-af03-f41e252eaa80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:32.662730 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-83ec468a-8878-449b-af03-f41e252eaa80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1319 microversion: 2.1 time: 0.145500 Jun 20 18:50:32.663579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 305/595] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:32 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:33.085622 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2afe799c-f24f-40a8-8e42-8ce491ec2ff4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:33.086244 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2afe799c-f24f-40a8-8e42-8ce491ec2ff4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:33.092878 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2afe799c-f24f-40a8-8e42-8ce491ec2ff4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:33.093319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2afe799c-f24f-40a8-8e42-8ce491ec2ff4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:33.094068 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2afe799c-f24f-40a8-8e42-8ce491ec2ff4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:33.094492 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2afe799c-f24f-40a8-8e42-8ce491ec2ff4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:33.223293 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2afe799c-f24f-40a8-8e42-8ce491ec2ff4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:33.231909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2afe799c-f24f-40a8-8e42-8ce491ec2ff4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:33.233425 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2afe799c-f24f-40a8-8e42-8ce491ec2ff4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:33.234572 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2afe799c-f24f-40a8-8e42-8ce491ec2ff4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.152962 Jun 20 18:50:33.235157 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 291/596] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:33 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:33.497420 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5914b259-3f0e-472b-b6b2-d0a1104e4587 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:33.498025 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5914b259-3f0e-472b-b6b2-d0a1104e4587 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:33.504005 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5914b259-3f0e-472b-b6b2-d0a1104e4587 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:33.504444 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5914b259-3f0e-472b-b6b2-d0a1104e4587 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:33.505185 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5914b259-3f0e-472b-b6b2-d0a1104e4587 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:33.505609 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5914b259-3f0e-472b-b6b2-d0a1104e4587 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:33.685611 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f256290c-61ef-46f6-b346-6bdcf519687a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:33.686212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f256290c-61ef-46f6-b346-6bdcf519687a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:33.692674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f256290c-61ef-46f6-b346-6bdcf519687a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:33.693123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f256290c-61ef-46f6-b346-6bdcf519687a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:33.693947 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f256290c-61ef-46f6-b346-6bdcf519687a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:33.694575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f256290c-61ef-46f6-b346-6bdcf519687a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:33.709144 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5914b259-3f0e-472b-b6b2-d0a1104e4587 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:33.716914 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5914b259-3f0e-472b-b6b2-d0a1104e4587 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1370 microversion: 2.1 time: 0.223752 Jun 20 18:50:33.718100 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 306/597] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:33 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:33.821259 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f256290c-61ef-46f6-b346-6bdcf519687a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:33.828544 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f256290c-61ef-46f6-b346-6bdcf519687a tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1319 microversion: 2.1 time: 0.147240 Jun 20 18:50:33.829100 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 292/598] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:33 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:34.252285 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-84ed4387-754f-4c90-8106-beed0683874f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:34.252885 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-84ed4387-754f-4c90-8106-beed0683874f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:34.258994 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-84ed4387-754f-4c90-8106-beed0683874f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:34.259442 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-84ed4387-754f-4c90-8106-beed0683874f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:34.260197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-84ed4387-754f-4c90-8106-beed0683874f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:34.260633 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-84ed4387-754f-4c90-8106-beed0683874f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:34.386981 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-84ed4387-754f-4c90-8106-beed0683874f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:34.394838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-84ed4387-754f-4c90-8106-beed0683874f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:34.396371 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-84ed4387-754f-4c90-8106-beed0683874f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:34.397512 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-84ed4387-754f-4c90-8106-beed0683874f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1740 microversion: 2.20 time: 0.149174 Jun 20 18:50:34.398071 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 307/599] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:34 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1740 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:50:34.733969 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-885dbf43-bed1-46f5-a752-37bc2c9d5668 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:34.734597 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-885dbf43-bed1-46f5-a752-37bc2c9d5668 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:34.741086 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-885dbf43-bed1-46f5-a752-37bc2c9d5668 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:34.741528 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-885dbf43-bed1-46f5-a752-37bc2c9d5668 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:34.742279 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-885dbf43-bed1-46f5-a752-37bc2c9d5668 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:34.742709 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-885dbf43-bed1-46f5-a752-37bc2c9d5668 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:34.844951 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-df788574-72d2-4e27-8027-d5a3b42a5c0e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:34.845557 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-df788574-72d2-4e27-8027-d5a3b42a5c0e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:34.852211 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-df788574-72d2-4e27-8027-d5a3b42a5c0e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:34.852653 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-df788574-72d2-4e27-8027-d5a3b42a5c0e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:34.853424 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-df788574-72d2-4e27-8027-d5a3b42a5c0e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:34.853852 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-df788574-72d2-4e27-8027-d5a3b42a5c0e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:34.878656 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-885dbf43-bed1-46f5-a752-37bc2c9d5668 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:34.886179 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-885dbf43-bed1-46f5-a752-37bc2c9d5668 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1370 microversion: 2.1 time: 0.156478 Jun 20 18:50:34.886744 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 293/600] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:34 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:34.981730 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-df788574-72d2-4e27-8027-d5a3b42a5c0e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:34.988972 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-df788574-72d2-4e27-8027-d5a3b42a5c0e tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1319 microversion: 2.1 time: 0.147906 Jun 20 18:50:34.989530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 308/601] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:34 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:35.415714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ed9a4b41-cee7-4475-a88f-38fa65a93373 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:35.416354 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ed9a4b41-cee7-4475-a88f-38fa65a93373 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:35.423218 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ed9a4b41-cee7-4475-a88f-38fa65a93373 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:35.423669 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ed9a4b41-cee7-4475-a88f-38fa65a93373 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:35.424448 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ed9a4b41-cee7-4475-a88f-38fa65a93373 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:35.425480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ed9a4b41-cee7-4475-a88f-38fa65a93373 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:35.551394 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ed9a4b41-cee7-4475-a88f-38fa65a93373 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:35.560210 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ed9a4b41-cee7-4475-a88f-38fa65a93373 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:35.561747 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ed9a4b41-cee7-4475-a88f-38fa65a93373 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:35.562962 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ed9a4b41-cee7-4475-a88f-38fa65a93373 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1722 microversion: 2.20 time: 0.151501 Jun 20 18:50:35.563518 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 294/602] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:35 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:35.903256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3309deab-b0c6-438c-a55d-9949b26052bf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:35.903784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-3309deab-b0c6-438c-a55d-9949b26052bf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:35.910217 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3309deab-b0c6-438c-a55d-9949b26052bf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:35.910653 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3309deab-b0c6-438c-a55d-9949b26052bf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:35.911440 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3309deab-b0c6-438c-a55d-9949b26052bf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:35.911872 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3309deab-b0c6-438c-a55d-9949b26052bf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:36.005389 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-29309989-5602-41ba-93ff-0881d1f17726 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:36.006079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-29309989-5602-41ba-93ff-0881d1f17726 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:36.013003 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-29309989-5602-41ba-93ff-0881d1f17726 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:36.013526 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-29309989-5602-41ba-93ff-0881d1f17726 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:36.014364 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-29309989-5602-41ba-93ff-0881d1f17726 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:36.014803 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-29309989-5602-41ba-93ff-0881d1f17726 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:36.041340 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-3309deab-b0c6-438c-a55d-9949b26052bf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:36.049030 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-3309deab-b0c6-438c-a55d-9949b26052bf tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1370 microversion: 2.1 time: 0.150172 Jun 20 18:50:36.050031 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 309/603] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:35 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:36.231218 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-29309989-5602-41ba-93ff-0881d1f17726 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:36.251923 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-29309989-5602-41ba-93ff-0881d1f17726 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1508 microversion: 2.1 time: 0.250207 Jun 20 18:50:36.258325 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-7830db80-5671-4ba1-8d42-2a6f24650f4c req-6b199da2-5bc3-461f-ab61-9bb8cdc77fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7fdf69c-2b2a-4801-82ca-54805176159b", "name": "network-vif-plugged", "status": "completed", "tag": "cbfc3863-3fe2-440b-acc3-803dbc08a337"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:36.262977 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 295/604] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:36 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:50:36.273371 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-7830db80-5671-4ba1-8d42-2a6f24650f4c req-6b199da2-5bc3-461f-ab61-9bb8cdc77fbb service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:36.274063 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-7830db80-5671-4ba1-8d42-2a6f24650f4c req-6b199da2-5bc3-461f-ab61-9bb8cdc77fbb service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:36.281960 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-91c4a2ce-566d-4573-9da1-afe44722516b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9eac24d4-0b94-49d7-8d64-f1fc75b43949", "device": "/dev/sdb"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:36.283421 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-91c4a2ce-566d-4573-9da1-afe44722516b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:36.288457 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-7830db80-5671-4ba1-8d42-2a6f24650f4c req-6b199da2-5bc3-461f-ab61-9bb8cdc77fbb service nova] Creating event network-vif-plugged:cbfc3863-3fe2-440b-acc3-803dbc08a337 for instance f7fdf69c-2b2a-4801-82ca-54805176159b on hv-cinder-83697 Jun 20 18:50:36.290461 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91c4a2ce-566d-4573-9da1-afe44722516b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:36.291181 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91c4a2ce-566d-4573-9da1-afe44722516b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:36.292145 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91c4a2ce-566d-4573-9da1-afe44722516b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:36.292801 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91c4a2ce-566d-4573-9da1-afe44722516b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:36.294121 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-7830db80-5671-4ba1-8d42-2a6f24650f4c req-6b199da2-5bc3-461f-ab61-9bb8cdc77fbb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041614 Jun 20 18:50:36.295287 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 310/605] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:50:36.582874 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c49ab24b-5b31-4d4d-8565-502e6a8d37df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:36.584095 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c49ab24b-5b31-4d4d-8565-502e6a8d37df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:36.592224 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c49ab24b-5b31-4d4d-8565-502e6a8d37df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:36.592984 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c49ab24b-5b31-4d4d-8565-502e6a8d37df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:36.594114 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c49ab24b-5b31-4d4d-8565-502e6a8d37df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:36.595172 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c49ab24b-5b31-4d4d-8565-502e6a8d37df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:36.643482 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:36.658298 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-91c4a2ce-566d-4573-9da1-afe44722516b tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "POST /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379830 Jun 20 18:50:36.659143 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 296/606] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jun 20 18:50:36 2022] POST /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:50:36.845427 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c49ab24b-5b31-4d4d-8565-502e6a8d37df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:36.853245 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c49ab24b-5b31-4d4d-8565-502e6a8d37df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:36.855264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c49ab24b-5b31-4d4d-8565-502e6a8d37df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:36.856404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c49ab24b-5b31-4d4d-8565-502e6a8d37df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1722 microversion: 2.20 time: 0.279372 Jun 20 18:50:36.856959 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 311/607] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:36 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:37.066524 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-35e10858-1de6-4bbc-a474-1f198f7b97b8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:37.067275 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-35e10858-1de6-4bbc-a474-1f198f7b97b8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:37.073463 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35e10858-1de6-4bbc-a474-1f198f7b97b8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:37.073909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35e10858-1de6-4bbc-a474-1f198f7b97b8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:37.074663 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35e10858-1de6-4bbc-a474-1f198f7b97b8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:37.075137 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35e10858-1de6-4bbc-a474-1f198f7b97b8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:37.202976 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-35e10858-1de6-4bbc-a474-1f198f7b97b8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:37.212913 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-35e10858-1de6-4bbc-a474-1f198f7b97b8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1370 microversion: 2.1 time: 0.151023 Jun 20 18:50:37.213500 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 297/608] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:37 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:37.874113 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-096bfe9c-3666-4a8f-92a7-ffecdee6f65e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:37.875456 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-096bfe9c-3666-4a8f-92a7-ffecdee6f65e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:37.882374 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-096bfe9c-3666-4a8f-92a7-ffecdee6f65e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:37.882821 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-096bfe9c-3666-4a8f-92a7-ffecdee6f65e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:37.883606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-096bfe9c-3666-4a8f-92a7-ffecdee6f65e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:37.884043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-096bfe9c-3666-4a8f-92a7-ffecdee6f65e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:38.012696 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-096bfe9c-3666-4a8f-92a7-ffecdee6f65e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:38.020571 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-096bfe9c-3666-4a8f-92a7-ffecdee6f65e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:38.022079 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-096bfe9c-3666-4a8f-92a7-ffecdee6f65e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:38.023309 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-096bfe9c-3666-4a8f-92a7-ffecdee6f65e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1722 microversion: 2.20 time: 0.153515 Jun 20 18:50:38.023868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 312/609] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:37 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:38.229429 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-60794087-e261-44ca-aba9-a3f12eb0b8e5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:38.230606 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-60794087-e261-44ca-aba9-a3f12eb0b8e5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:38.237094 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-60794087-e261-44ca-aba9-a3f12eb0b8e5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:38.237538 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-60794087-e261-44ca-aba9-a3f12eb0b8e5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:38.238328 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-60794087-e261-44ca-aba9-a3f12eb0b8e5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:38.238767 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-60794087-e261-44ca-aba9-a3f12eb0b8e5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:38.339762 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-4aae0bdd-b774-4e0e-ae29-91e9f5e409da req-29c98918-3d8a-425f-b974-78f7874ff352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa52c387-5b77-4644-85c8-691b22dfeb78", "name": "network-vif-unplugged", "status": "completed", "tag": "920abf72-084f-4d4e-be79-106c82668c67"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:38.347676 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-4aae0bdd-b774-4e0e-ae29-91e9f5e409da req-29c98918-3d8a-425f-b974-78f7874ff352 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:38.348112 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-4aae0bdd-b774-4e0e-ae29-91e9f5e409da req-29c98918-3d8a-425f-b974-78f7874ff352 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:38.358576 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-4aae0bdd-b774-4e0e-ae29-91e9f5e409da req-29c98918-3d8a-425f-b974-78f7874ff352 service nova] Creating event network-vif-unplugged:920abf72-084f-4d4e-be79-106c82668c67 for instance aa52c387-5b77-4644-85c8-691b22dfeb78 on hv-cinder-83697 Jun 20 18:50:38.363493 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-4aae0bdd-b774-4e0e-ae29-91e9f5e409da req-29c98918-3d8a-425f-b974-78f7874ff352 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028023 Jun 20 18:50:38.364073 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 313/610] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:50:38.364229 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-60794087-e261-44ca-aba9-a3f12eb0b8e5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:38.372239 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-60794087-e261-44ca-aba9-a3f12eb0b8e5 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1370 microversion: 2.1 time: 0.146651 Jun 20 18:50:38.372781 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 298/611] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:38 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:39.043067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-63941ba9-0d68-482e-9045-f3790e74ae3e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:39.043844 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-63941ba9-0d68-482e-9045-f3790e74ae3e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:39.050371 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-63941ba9-0d68-482e-9045-f3790e74ae3e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:39.050808 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-63941ba9-0d68-482e-9045-f3790e74ae3e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:39.051595 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-63941ba9-0d68-482e-9045-f3790e74ae3e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:39.052041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-63941ba9-0d68-482e-9045-f3790e74ae3e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:39.179201 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-63941ba9-0d68-482e-9045-f3790e74ae3e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:39.187553 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-63941ba9-0d68-482e-9045-f3790e74ae3e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:39.189027 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-63941ba9-0d68-482e-9045-f3790e74ae3e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:39.190164 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-63941ba9-0d68-482e-9045-f3790e74ae3e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1722 microversion: 2.20 time: 0.152154 Jun 20 18:50:39.190717 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 314/612] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:39 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:39.389013 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6f87a539-7eea-4364-8086-52f5616acbdb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:39.389625 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6f87a539-7eea-4364-8086-52f5616acbdb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:39.396185 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6f87a539-7eea-4364-8086-52f5616acbdb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:39.396645 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6f87a539-7eea-4364-8086-52f5616acbdb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:39.397409 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6f87a539-7eea-4364-8086-52f5616acbdb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:39.397848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6f87a539-7eea-4364-8086-52f5616acbdb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:39.757292 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6f87a539-7eea-4364-8086-52f5616acbdb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:39.765263 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6f87a539-7eea-4364-8086-52f5616acbdb tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1370 microversion: 2.1 time: 0.380175 Jun 20 18:50:39.765820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 299/613] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:39 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1370 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:40.208133 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6e1395dd-c518-4bc9-b029-0438c9d82442 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:40.208746 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6e1395dd-c518-4bc9-b029-0438c9d82442 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:40.216361 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6e1395dd-c518-4bc9-b029-0438c9d82442 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:40.216474 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6e1395dd-c518-4bc9-b029-0438c9d82442 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:40.217206 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6e1395dd-c518-4bc9-b029-0438c9d82442 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:40.217632 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6e1395dd-c518-4bc9-b029-0438c9d82442 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:40.393532 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6e1395dd-c518-4bc9-b029-0438c9d82442 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:40.402799 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6e1395dd-c518-4bc9-b029-0438c9d82442 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:40.404496 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6e1395dd-c518-4bc9-b029-0438c9d82442 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:40.405667 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6e1395dd-c518-4bc9-b029-0438c9d82442 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1722 microversion: 2.20 time: 0.201396 Jun 20 18:50:40.406221 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 315/614] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:40 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:40.782018 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b568d76e-e828-4d07-8677-030dfeb5fbae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:40.782709 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b568d76e-e828-4d07-8677-030dfeb5fbae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:40.789199 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b568d76e-e828-4d07-8677-030dfeb5fbae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:40.789639 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b568d76e-e828-4d07-8677-030dfeb5fbae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:40.790384 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b568d76e-e828-4d07-8677-030dfeb5fbae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:40.790819 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b568d76e-e828-4d07-8677-030dfeb5fbae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:40.927941 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b568d76e-e828-4d07-8677-030dfeb5fbae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:40.935595 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b568d76e-e828-4d07-8677-030dfeb5fbae tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1370 microversion: 2.1 time: 0.157528 Jun 20 18:50:40.936201 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 300/615] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:40 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:41.424198 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f973b9eb-f2fe-4086-914a-9c0543765b25 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:41.424734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f973b9eb-f2fe-4086-914a-9c0543765b25 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:41.431286 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f973b9eb-f2fe-4086-914a-9c0543765b25 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:41.431733 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f973b9eb-f2fe-4086-914a-9c0543765b25 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:41.432483 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f973b9eb-f2fe-4086-914a-9c0543765b25 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:41.432974 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f973b9eb-f2fe-4086-914a-9c0543765b25 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:41.560668 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f973b9eb-f2fe-4086-914a-9c0543765b25 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:41.568519 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f973b9eb-f2fe-4086-914a-9c0543765b25 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:41.570010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f973b9eb-f2fe-4086-914a-9c0543765b25 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:41.571175 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f973b9eb-f2fe-4086-914a-9c0543765b25 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1665 microversion: 2.20 time: 0.150887 Jun 20 18:50:41.571731 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 316/616] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:41 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1665 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:41.588896 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-fe351b1e-d9d1-473f-8420-19919468ab20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed9e77b4-e4cd-43a8-8806-379e34217797"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:41.590705 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-fe351b1e-d9d1-473f-8420-19919468ab20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:41.596787 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fe351b1e-d9d1-473f-8420-19919468ab20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:41.597232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fe351b1e-d9d1-473f-8420-19919468ab20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:41.597987 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fe351b1e-d9d1-473f-8420-19919468ab20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:41.598420 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fe351b1e-d9d1-473f-8420-19919468ab20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:41.868958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-fe351b1e-d9d1-473f-8420-19919468ab20 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "POST /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.284018 Jun 20 18:50:41.869588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 301/617] 10.222.0.43 () {62 vars in 1363 bytes} [Mon Jun 20 18:50:41 2022] POST /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/os-volume_attachments => generated 188 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:50:41.953342 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e21e3fe8-7da8-4f61-9ff2-80d809c8a399 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:41.953946 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e21e3fe8-7da8-4f61-9ff2-80d809c8a399 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:41.959996 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e21e3fe8-7da8-4f61-9ff2-80d809c8a399 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:41.960439 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e21e3fe8-7da8-4f61-9ff2-80d809c8a399 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:41.961188 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e21e3fe8-7da8-4f61-9ff2-80d809c8a399 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:41.961612 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e21e3fe8-7da8-4f61-9ff2-80d809c8a399 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:41.988872 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f41869c6-a71d-4f60-9f95-7b9dc59f795c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:41.989431 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f41869c6-a71d-4f60-9f95-7b9dc59f795c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:41.996873 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f41869c6-a71d-4f60-9f95-7b9dc59f795c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:41.996873 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f41869c6-a71d-4f60-9f95-7b9dc59f795c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:41.997311 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f41869c6-a71d-4f60-9f95-7b9dc59f795c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:41.997910 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f41869c6-a71d-4f60-9f95-7b9dc59f795c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:42.094041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e21e3fe8-7da8-4f61-9ff2-80d809c8a399 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:42.094240 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f41869c6-a71d-4f60-9f95-7b9dc59f795c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "POST /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/action" status: 202 len: 0 microversion: 2.20 time: 0.108882 Jun 20 18:50:42.094665 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 302/618] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Jun 20 18:50:41 2022] POST /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 20 18:50:42.100632 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:42.103108 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-30d2abe5-8b96-40df-9d97-87b9934dd5e2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:42.103862 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e21e3fe8-7da8-4f61-9ff2-80d809c8a399 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1564 microversion: 2.1 time: 0.154249 Jun 20 18:50:42.103992 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-30d2abe5-8b96-40df-9d97-87b9934dd5e2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:42.105330 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 317/619] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:50:41 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:50:42.111111 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-30d2abe5-8b96-40df-9d97-87b9934dd5e2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:42.111563 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-30d2abe5-8b96-40df-9d97-87b9934dd5e2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:42.112582 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-30d2abe5-8b96-40df-9d97-87b9934dd5e2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:42.112868 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-30d2abe5-8b96-40df-9d97-87b9934dd5e2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:42.121822 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-524b5527-a026-48e5-afa9-f8fcc0b14b26 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:42.122538 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-524b5527-a026-48e5-afa9-f8fcc0b14b26 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:42.129863 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-524b5527-a026-48e5-afa9-f8fcc0b14b26 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:42.130549 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-524b5527-a026-48e5-afa9-f8fcc0b14b26 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:42.131656 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-524b5527-a026-48e5-afa9-f8fcc0b14b26 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:42.132096 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-524b5527-a026-48e5-afa9-f8fcc0b14b26 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:42.231078 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-524b5527-a026-48e5-afa9-f8fcc0b14b26 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114065 Jun 20 18:50:42.232252 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 318/620] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jun 20 18:50:42 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:50:42.271914 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-30d2abe5-8b96-40df-9d97-87b9934dd5e2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:42.286362 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-30d2abe5-8b96-40df-9d97-87b9934dd5e2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:42.289048 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-30d2abe5-8b96-40df-9d97-87b9934dd5e2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:42.290527 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-30d2abe5-8b96-40df-9d97-87b9934dd5e2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1751 microversion: 2.20 time: 0.191917 Jun 20 18:50:42.291757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 303/621] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:42 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:50:43.310724 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c11cd79c-23cf-4e00-be41-f44be7406fbb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:43.312339 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c11cd79c-23cf-4e00-be41-f44be7406fbb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:43.318367 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c11cd79c-23cf-4e00-be41-f44be7406fbb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:43.318812 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c11cd79c-23cf-4e00-be41-f44be7406fbb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:43.319617 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c11cd79c-23cf-4e00-be41-f44be7406fbb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:43.320051 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c11cd79c-23cf-4e00-be41-f44be7406fbb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:43.447879 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-ab0ab8f3-6ebb-4037-bc5d-9b4ba10b9f54 req-d4d81d09-6991-4369-a6e4-81a6c76bc9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7fdf69c-2b2a-4801-82ca-54805176159b", "tag": "cbfc3863-3fe2-440b-acc3-803dbc08a337"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:50:43.457552 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-ab0ab8f3-6ebb-4037-bc5d-9b4ba10b9f54 req-d4d81d09-6991-4369-a6e4-81a6c76bc9e0 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:43.458900 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-ab0ab8f3-6ebb-4037-bc5d-9b4ba10b9f54 req-d4d81d09-6991-4369-a6e4-81a6c76bc9e0 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:43.470760 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-ab0ab8f3-6ebb-4037-bc5d-9b4ba10b9f54 req-d4d81d09-6991-4369-a6e4-81a6c76bc9e0 service nova] Creating event network-changed:cbfc3863-3fe2-440b-acc3-803dbc08a337 for instance f7fdf69c-2b2a-4801-82ca-54805176159b on hv-cinder-83697 Jun 20 18:50:43.476092 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-ab0ab8f3-6ebb-4037-bc5d-9b4ba10b9f54 req-d4d81d09-6991-4369-a6e4-81a6c76bc9e0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031922 Jun 20 18:50:43.476973 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 304/622] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:50:43.491396 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c11cd79c-23cf-4e00-be41-f44be7406fbb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:43.499858 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c11cd79c-23cf-4e00-be41-f44be7406fbb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:43.512214 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c11cd79c-23cf-4e00-be41-f44be7406fbb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:43.513334 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c11cd79c-23cf-4e00-be41-f44be7406fbb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1753 microversion: 2.20 time: 0.207148 Jun 20 18:50:43.514239 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 319/623] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:43 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1753 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:44.533297 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7be31d96-0eae-4195-a469-fe07a517d7df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:44.533901 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7be31d96-0eae-4195-a469-fe07a517d7df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:44.540835 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7be31d96-0eae-4195-a469-fe07a517d7df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:44.541274 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7be31d96-0eae-4195-a469-fe07a517d7df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:44.542071 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7be31d96-0eae-4195-a469-fe07a517d7df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:44.542499 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7be31d96-0eae-4195-a469-fe07a517d7df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:44.671015 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7be31d96-0eae-4195-a469-fe07a517d7df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:44.679272 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7be31d96-0eae-4195-a469-fe07a517d7df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:44.680788 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7be31d96-0eae-4195-a469-fe07a517d7df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:44.681918 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7be31d96-0eae-4195-a469-fe07a517d7df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1753 microversion: 2.20 time: 0.152987 Jun 20 18:50:44.682494 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 305/624] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:44 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:45.700094 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d18c04f4-321b-4b72-b5ef-3bcc6796a404 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:45.700630 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d18c04f4-321b-4b72-b5ef-3bcc6796a404 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:45.707195 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d18c04f4-321b-4b72-b5ef-3bcc6796a404 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:45.707637 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d18c04f4-321b-4b72-b5ef-3bcc6796a404 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:45.708382 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d18c04f4-321b-4b72-b5ef-3bcc6796a404 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:45.708807 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d18c04f4-321b-4b72-b5ef-3bcc6796a404 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:45.841021 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d18c04f4-321b-4b72-b5ef-3bcc6796a404 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:45.849194 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d18c04f4-321b-4b72-b5ef-3bcc6796a404 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:45.850670 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d18c04f4-321b-4b72-b5ef-3bcc6796a404 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:45.851829 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d18c04f4-321b-4b72-b5ef-3bcc6796a404 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1753 microversion: 2.20 time: 0.155705 Jun 20 18:50:45.852381 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 320/625] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:45 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:46.869643 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4d337b05-3e81-4a7e-8cd8-8fee49ddfdc0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:46.870825 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-4d337b05-3e81-4a7e-8cd8-8fee49ddfdc0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:46.877354 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4d337b05-3e81-4a7e-8cd8-8fee49ddfdc0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:46.877794 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4d337b05-3e81-4a7e-8cd8-8fee49ddfdc0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:46.878544 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4d337b05-3e81-4a7e-8cd8-8fee49ddfdc0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:46.878991 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4d337b05-3e81-4a7e-8cd8-8fee49ddfdc0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:47.004735 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4d337b05-3e81-4a7e-8cd8-8fee49ddfdc0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:47.013024 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4d337b05-3e81-4a7e-8cd8-8fee49ddfdc0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:47.014514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4d337b05-3e81-4a7e-8cd8-8fee49ddfdc0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:47.015670 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4d337b05-3e81-4a7e-8cd8-8fee49ddfdc0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1753 microversion: 2.20 time: 0.150056 Jun 20 18:50:47.016216 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 306/626] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:46 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:48.034004 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a9fc3f40-3e96-4a5f-9ff8-a290272c024a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:48.034592 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a9fc3f40-3e96-4a5f-9ff8-a290272c024a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:48.036590 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=83 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:48.042497 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a9fc3f40-3e96-4a5f-9ff8-a290272c024a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:48.042984 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a9fc3f40-3e96-4a5f-9ff8-a290272c024a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:48.043749 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a9fc3f40-3e96-4a5f-9ff8-a290272c024a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:48.044175 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a9fc3f40-3e96-4a5f-9ff8-a290272c024a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:48.170136 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a9fc3f40-3e96-4a5f-9ff8-a290272c024a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:48.178585 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a9fc3f40-3e96-4a5f-9ff8-a290272c024a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:48.180129 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a9fc3f40-3e96-4a5f-9ff8-a290272c024a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:48.181257 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a9fc3f40-3e96-4a5f-9ff8-a290272c024a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1753 microversion: 2.20 time: 0.151300 Jun 20 18:50:48.181807 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 321/627] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:48 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:49.200138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-bdc38f6a-acff-4a8a-9287-6a7120cf5b7a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:49.200714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-bdc38f6a-acff-4a8a-9287-6a7120cf5b7a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:49.207108 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bdc38f6a-acff-4a8a-9287-6a7120cf5b7a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:49.207550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bdc38f6a-acff-4a8a-9287-6a7120cf5b7a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:49.208292 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bdc38f6a-acff-4a8a-9287-6a7120cf5b7a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:49.208719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bdc38f6a-acff-4a8a-9287-6a7120cf5b7a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:49.333421 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-bdc38f6a-acff-4a8a-9287-6a7120cf5b7a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:49.341915 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-bdc38f6a-acff-4a8a-9287-6a7120cf5b7a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:49.343425 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-bdc38f6a-acff-4a8a-9287-6a7120cf5b7a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:49.344564 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-bdc38f6a-acff-4a8a-9287-6a7120cf5b7a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1753 microversion: 2.20 time: 0.148848 Jun 20 18:50:49.345108 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 307/628] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:49 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:50.362775 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0902f38b-bac0-447a-935f-eb3a522684d5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:50.363414 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0902f38b-bac0-447a-935f-eb3a522684d5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:50.369872 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0902f38b-bac0-447a-935f-eb3a522684d5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:50.370898 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0902f38b-bac0-447a-935f-eb3a522684d5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:50.371675 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0902f38b-bac0-447a-935f-eb3a522684d5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:50.372106 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0902f38b-bac0-447a-935f-eb3a522684d5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:50.497411 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0902f38b-bac0-447a-935f-eb3a522684d5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:50.505715 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0902f38b-bac0-447a-935f-eb3a522684d5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:50.507233 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0902f38b-bac0-447a-935f-eb3a522684d5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:50.508376 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0902f38b-bac0-447a-935f-eb3a522684d5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.149558 Jun 20 18:50:50.508928 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 322/629] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:50 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:51.527274 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ee158847-2c51-4dc9-9d33-0ec405b39642 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:51.527873 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ee158847-2c51-4dc9-9d33-0ec405b39642 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:51.534301 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ee158847-2c51-4dc9-9d33-0ec405b39642 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:51.534742 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ee158847-2c51-4dc9-9d33-0ec405b39642 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:51.535526 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ee158847-2c51-4dc9-9d33-0ec405b39642 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:51.535956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ee158847-2c51-4dc9-9d33-0ec405b39642 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:51.665554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ee158847-2c51-4dc9-9d33-0ec405b39642 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:51.673776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ee158847-2c51-4dc9-9d33-0ec405b39642 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:51.675277 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ee158847-2c51-4dc9-9d33-0ec405b39642 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:51.676404 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ee158847-2c51-4dc9-9d33-0ec405b39642 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.153482 Jun 20 18:50:51.676949 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 308/630] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:51 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:52.694909 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-398d7d44-deaa-43c1-9f8b-2da3220cb915 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:52.695494 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-398d7d44-deaa-43c1-9f8b-2da3220cb915 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:52.702253 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-398d7d44-deaa-43c1-9f8b-2da3220cb915 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:52.702693 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-398d7d44-deaa-43c1-9f8b-2da3220cb915 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:52.703477 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-398d7d44-deaa-43c1-9f8b-2da3220cb915 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:52.703900 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-398d7d44-deaa-43c1-9f8b-2da3220cb915 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:52.832997 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-398d7d44-deaa-43c1-9f8b-2da3220cb915 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:52.841758 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-398d7d44-deaa-43c1-9f8b-2da3220cb915 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:52.843265 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-398d7d44-deaa-43c1-9f8b-2da3220cb915 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:52.844527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-398d7d44-deaa-43c1-9f8b-2da3220cb915 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.153699 Jun 20 18:50:52.845088 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 323/631] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:52 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:53.863410 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-221a4fda-5091-4e78-b256-3e041ce1297a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:53.864018 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-221a4fda-5091-4e78-b256-3e041ce1297a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:53.870619 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-221a4fda-5091-4e78-b256-3e041ce1297a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:53.871099 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-221a4fda-5091-4e78-b256-3e041ce1297a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:53.871858 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-221a4fda-5091-4e78-b256-3e041ce1297a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:53.872290 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-221a4fda-5091-4e78-b256-3e041ce1297a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:53.996185 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-221a4fda-5091-4e78-b256-3e041ce1297a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:54.004431 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-221a4fda-5091-4e78-b256-3e041ce1297a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:54.005913 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-221a4fda-5091-4e78-b256-3e041ce1297a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:54.007084 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-221a4fda-5091-4e78-b256-3e041ce1297a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.147571 Jun 20 18:50:54.007656 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 309/632] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:53 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:55.025608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fcc4222b-8f91-40ff-af84-63c13e979f39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:55.026296 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fcc4222b-8f91-40ff-af84-63c13e979f39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:55.033650 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fcc4222b-8f91-40ff-af84-63c13e979f39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:55.034096 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fcc4222b-8f91-40ff-af84-63c13e979f39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:55.034897 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fcc4222b-8f91-40ff-af84-63c13e979f39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:55.035448 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fcc4222b-8f91-40ff-af84-63c13e979f39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:55.239356 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fcc4222b-8f91-40ff-af84-63c13e979f39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:55.247831 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fcc4222b-8f91-40ff-af84-63c13e979f39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:55.249339 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fcc4222b-8f91-40ff-af84-63c13e979f39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:55.250534 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fcc4222b-8f91-40ff-af84-63c13e979f39 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.228793 Jun 20 18:50:55.251186 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 324/633] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:55 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:56.269332 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-083dc046-9f39-4f0f-806b-6a45489bf31d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:56.270223 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-083dc046-9f39-4f0f-806b-6a45489bf31d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:56.277559 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-083dc046-9f39-4f0f-806b-6a45489bf31d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:56.278000 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-083dc046-9f39-4f0f-806b-6a45489bf31d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:56.278792 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-083dc046-9f39-4f0f-806b-6a45489bf31d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:56.279257 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-083dc046-9f39-4f0f-806b-6a45489bf31d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:56.294229 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:INSERT=5,nova_cell1:SELECT=90,nova_cell1:UPDATE=5 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:56.414302 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-083dc046-9f39-4f0f-806b-6a45489bf31d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:56.423489 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-083dc046-9f39-4f0f-806b-6a45489bf31d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:56.425114 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-083dc046-9f39-4f0f-806b-6a45489bf31d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:56.426278 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-083dc046-9f39-4f0f-806b-6a45489bf31d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.161086 Jun 20 18:50:56.426830 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 310/634] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:56 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:57.444596 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-89e0b6d3-a44b-40e0-84f3-e30efb0f6ba1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:57.445209 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-89e0b6d3-a44b-40e0-84f3-e30efb0f6ba1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:57.452379 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-89e0b6d3-a44b-40e0-84f3-e30efb0f6ba1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:57.452831 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-89e0b6d3-a44b-40e0-84f3-e30efb0f6ba1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:57.453592 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-89e0b6d3-a44b-40e0-84f3-e30efb0f6ba1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:57.454026 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-89e0b6d3-a44b-40e0-84f3-e30efb0f6ba1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:57.580775 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-89e0b6d3-a44b-40e0-84f3-e30efb0f6ba1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:57.589132 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-89e0b6d3-a44b-40e0-84f3-e30efb0f6ba1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:57.590639 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-89e0b6d3-a44b-40e0-84f3-e30efb0f6ba1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:57.591822 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-89e0b6d3-a44b-40e0-84f3-e30efb0f6ba1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.151292 Jun 20 18:50:57.592401 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 325/635] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:57 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:58.610471 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ca4332f1-610e-47d8-bc72-15340d90b1a5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:58.611115 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ca4332f1-610e-47d8-bc72-15340d90b1a5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:58.617585 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ca4332f1-610e-47d8-bc72-15340d90b1a5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:58.618026 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ca4332f1-610e-47d8-bc72-15340d90b1a5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:58.618774 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ca4332f1-610e-47d8-bc72-15340d90b1a5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:58.619240 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ca4332f1-610e-47d8-bc72-15340d90b1a5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:58.749613 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ca4332f1-610e-47d8-bc72-15340d90b1a5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:58.758153 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ca4332f1-610e-47d8-bc72-15340d90b1a5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:58.759701 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ca4332f1-610e-47d8-bc72-15340d90b1a5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:58.760852 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ca4332f1-610e-47d8-bc72-15340d90b1a5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.154333 Jun 20 18:50:58.761899 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 311/636] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:58 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:50:59.780005 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-36720a29-a559-4adb-806a-efb75c16b609 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:50:59.780782 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-36720a29-a559-4adb-806a-efb75c16b609 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:50:59.788752 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-36720a29-a559-4adb-806a-efb75c16b609 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:59.789286 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-36720a29-a559-4adb-806a-efb75c16b609 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:59.790127 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-36720a29-a559-4adb-806a-efb75c16b609 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:50:59.790566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-36720a29-a559-4adb-806a-efb75c16b609 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:50:59.929049 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-36720a29-a559-4adb-806a-efb75c16b609 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:59.939177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-36720a29-a559-4adb-806a-efb75c16b609 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:59.940769 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-36720a29-a559-4adb-806a-efb75c16b609 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:50:59.942016 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-36720a29-a559-4adb-806a-efb75c16b609 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.166527 Jun 20 18:50:59.943154 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 326/637] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:50:59 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:00.960916 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ff524577-ef8e-4c78-9bee-457904997efe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:00.961518 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ff524577-ef8e-4c78-9bee-457904997efe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:00.963808 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=52 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:51:00.969140 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ff524577-ef8e-4c78-9bee-457904997efe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:00.969521 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ff524577-ef8e-4c78-9bee-457904997efe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:00.970262 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ff524577-ef8e-4c78-9bee-457904997efe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:00.970691 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ff524577-ef8e-4c78-9bee-457904997efe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:01.101049 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ff524577-ef8e-4c78-9bee-457904997efe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:01.109941 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ff524577-ef8e-4c78-9bee-457904997efe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:01.111446 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ff524577-ef8e-4c78-9bee-457904997efe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:01.112752 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ff524577-ef8e-4c78-9bee-457904997efe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.155744 Jun 20 18:51:01.113305 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 312/638] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:00 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:02.131585 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-14892134-59b1-4bad-8eeb-99c656a0a3a7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:02.132177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-14892134-59b1-4bad-8eeb-99c656a0a3a7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:02.139249 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-14892134-59b1-4bad-8eeb-99c656a0a3a7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:02.139694 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-14892134-59b1-4bad-8eeb-99c656a0a3a7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:02.140472 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-14892134-59b1-4bad-8eeb-99c656a0a3a7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:02.140903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-14892134-59b1-4bad-8eeb-99c656a0a3a7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:02.276198 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-14892134-59b1-4bad-8eeb-99c656a0a3a7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:02.285758 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-14892134-59b1-4bad-8eeb-99c656a0a3a7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:02.287493 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-14892134-59b1-4bad-8eeb-99c656a0a3a7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:02.289125 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-14892134-59b1-4bad-8eeb-99c656a0a3a7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.161958 Jun 20 18:51:02.289939 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 327/639] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:02 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:03.307364 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f340351d-c25d-4172-9ff7-00b0f1b7a28f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:03.307920 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f340351d-c25d-4172-9ff7-00b0f1b7a28f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:03.315051 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f340351d-c25d-4172-9ff7-00b0f1b7a28f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:03.315494 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f340351d-c25d-4172-9ff7-00b0f1b7a28f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:03.316239 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f340351d-c25d-4172-9ff7-00b0f1b7a28f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:03.316663 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f340351d-c25d-4172-9ff7-00b0f1b7a28f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:03.508002 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f340351d-c25d-4172-9ff7-00b0f1b7a28f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:03.517072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f340351d-c25d-4172-9ff7-00b0f1b7a28f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:03.518568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f340351d-c25d-4172-9ff7-00b0f1b7a28f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:03.519755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f340351d-c25d-4172-9ff7-00b0f1b7a28f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.216340 Jun 20 18:51:03.520504 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 313/640] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:03 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:04.539906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1ee3254d-3a78-4c56-99ff-c9d6d7bc5e92 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:04.540529 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1ee3254d-3a78-4c56-99ff-c9d6d7bc5e92 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:04.547675 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1ee3254d-3a78-4c56-99ff-c9d6d7bc5e92 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:04.548122 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1ee3254d-3a78-4c56-99ff-c9d6d7bc5e92 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:04.548873 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1ee3254d-3a78-4c56-99ff-c9d6d7bc5e92 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:04.549304 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1ee3254d-3a78-4c56-99ff-c9d6d7bc5e92 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:04.680071 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1ee3254d-3a78-4c56-99ff-c9d6d7bc5e92 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:04.689141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1ee3254d-3a78-4c56-99ff-c9d6d7bc5e92 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:04.690640 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1ee3254d-3a78-4c56-99ff-c9d6d7bc5e92 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:04.691823 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1ee3254d-3a78-4c56-99ff-c9d6d7bc5e92 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.156695 Jun 20 18:51:04.692372 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 328/641] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:04 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:05.709786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6661ef37-19f9-4008-ad43-d23bbba2b303 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:05.710489 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6661ef37-19f9-4008-ad43-d23bbba2b303 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:05.718579 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6661ef37-19f9-4008-ad43-d23bbba2b303 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:05.718579 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6661ef37-19f9-4008-ad43-d23bbba2b303 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:05.719164 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6661ef37-19f9-4008-ad43-d23bbba2b303 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:05.719598 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6661ef37-19f9-4008-ad43-d23bbba2b303 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:05.850469 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6661ef37-19f9-4008-ad43-d23bbba2b303 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:05.859040 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6661ef37-19f9-4008-ad43-d23bbba2b303 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:05.860550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6661ef37-19f9-4008-ad43-d23bbba2b303 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:05.861716 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6661ef37-19f9-4008-ad43-d23bbba2b303 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.155908 Jun 20 18:51:05.862265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 314/642] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:05 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:06.881276 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f45271e8-0406-4cf6-94b9-7205c31d8a10 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:06.883117 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f45271e8-0406-4cf6-94b9-7205c31d8a10 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:06.890884 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f45271e8-0406-4cf6-94b9-7205c31d8a10 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:06.891653 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f45271e8-0406-4cf6-94b9-7205c31d8a10 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:06.892521 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f45271e8-0406-4cf6-94b9-7205c31d8a10 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:06.893155 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f45271e8-0406-4cf6-94b9-7205c31d8a10 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:07.070814 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f45271e8-0406-4cf6-94b9-7205c31d8a10 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:07.080603 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f45271e8-0406-4cf6-94b9-7205c31d8a10 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:07.082121 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f45271e8-0406-4cf6-94b9-7205c31d8a10 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:07.083340 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f45271e8-0406-4cf6-94b9-7205c31d8a10 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.206867 Jun 20 18:51:07.084119 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 329/643] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:06 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:08.102465 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0937032e-f341-48b8-8b18-1dea5eee210f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:08.103103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0937032e-f341-48b8-8b18-1dea5eee210f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:08.110337 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0937032e-f341-48b8-8b18-1dea5eee210f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:08.110830 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0937032e-f341-48b8-8b18-1dea5eee210f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:08.111819 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0937032e-f341-48b8-8b18-1dea5eee210f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:08.112272 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0937032e-f341-48b8-8b18-1dea5eee210f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:08.245517 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0937032e-f341-48b8-8b18-1dea5eee210f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:08.253914 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0937032e-f341-48b8-8b18-1dea5eee210f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:08.255420 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0937032e-f341-48b8-8b18-1dea5eee210f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:08.256572 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0937032e-f341-48b8-8b18-1dea5eee210f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.158073 Jun 20 18:51:08.257126 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 315/644] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:08 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:09.275296 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d6cc6dc3-a3e9-46f4-ba24-eea34253eda3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:09.275881 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d6cc6dc3-a3e9-46f4-ba24-eea34253eda3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:09.283108 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6cc6dc3-a3e9-46f4-ba24-eea34253eda3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:09.283620 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6cc6dc3-a3e9-46f4-ba24-eea34253eda3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:09.284562 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6cc6dc3-a3e9-46f4-ba24-eea34253eda3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:09.285003 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6cc6dc3-a3e9-46f4-ba24-eea34253eda3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:09.422942 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d6cc6dc3-a3e9-46f4-ba24-eea34253eda3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:09.431344 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d6cc6dc3-a3e9-46f4-ba24-eea34253eda3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:09.433370 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d6cc6dc3-a3e9-46f4-ba24-eea34253eda3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:09.434511 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d6cc6dc3-a3e9-46f4-ba24-eea34253eda3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.163212 Jun 20 18:51:09.435090 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 330/645] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:09 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:09.482715 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7915c8f4-d674-4d0f-91fc-11c81f2f8deb tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:09.483471 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7915c8f4-d674-4d0f-91fc-11c81f2f8deb tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:09.489961 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7915c8f4-d674-4d0f-91fc-11c81f2f8deb tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:09.490406 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7915c8f4-d674-4d0f-91fc-11c81f2f8deb tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:09.491189 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7915c8f4-d674-4d0f-91fc-11c81f2f8deb tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:09.491619 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7915c8f4-d674-4d0f-91fc-11c81f2f8deb tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:09.622830 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-7915c8f4-d674-4d0f-91fc-11c81f2f8deb tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lazy-loading 'services' on Instance uuid 96a4746c-b747-44dc-a25d-dc1ab9843931 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:51:09.742166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7915c8f4-d674-4d0f-91fc-11c81f2f8deb tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "DELETE /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931/os-volume_attachments/9eac24d4-0b94-49d7-8d64-f1fc75b43949" status: 202 len: 0 microversion: 2.1 time: 0.263229 Jun 20 18:51:09.742778 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 316/646] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jun 20 18:51:09 2022] DELETE /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931/os-volume_attachments/9eac24d4-0b94-49d7-8d64-f1fc75b43949 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:51:10.451928 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d08e2cf8-1515-4be8-9485-db104d3753e1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:10.452541 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d08e2cf8-1515-4be8-9485-db104d3753e1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:10.459038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d08e2cf8-1515-4be8-9485-db104d3753e1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:10.459479 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d08e2cf8-1515-4be8-9485-db104d3753e1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:10.460229 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d08e2cf8-1515-4be8-9485-db104d3753e1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:10.460656 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d08e2cf8-1515-4be8-9485-db104d3753e1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:10.603200 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d08e2cf8-1515-4be8-9485-db104d3753e1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:10.611710 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d08e2cf8-1515-4be8-9485-db104d3753e1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:10.613229 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d08e2cf8-1515-4be8-9485-db104d3753e1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:10.614377 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d08e2cf8-1515-4be8-9485-db104d3753e1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.166492 Jun 20 18:51:10.614941 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 331/647] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:10 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:11.745168 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-cc318b39-047e-4934-a4ba-04baf65caf38 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:11.745851 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-cc318b39-047e-4934-a4ba-04baf65caf38 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:11.752108 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cc318b39-047e-4934-a4ba-04baf65caf38 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:11.752548 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cc318b39-047e-4934-a4ba-04baf65caf38 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:11.753296 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cc318b39-047e-4934-a4ba-04baf65caf38 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:11.753725 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cc318b39-047e-4934-a4ba-04baf65caf38 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:11.908570 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cc318b39-047e-4934-a4ba-04baf65caf38 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:11.917325 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cc318b39-047e-4934-a4ba-04baf65caf38 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:11.918814 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cc318b39-047e-4934-a4ba-04baf65caf38 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:11.920571 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-cc318b39-047e-4934-a4ba-04baf65caf38 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.291581 Jun 20 18:51:11.921124 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 317/648] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:11 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:12.940146 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-99d5af8c-b552-431a-b33c-3a7abd30c399 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:12.940747 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-99d5af8c-b552-431a-b33c-3a7abd30c399 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:12.947312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-99d5af8c-b552-431a-b33c-3a7abd30c399 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:12.947751 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-99d5af8c-b552-431a-b33c-3a7abd30c399 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:12.948587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-99d5af8c-b552-431a-b33c-3a7abd30c399 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:12.949018 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-99d5af8c-b552-431a-b33c-3a7abd30c399 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:12.952026 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=84 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:51:13.077972 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-99d5af8c-b552-431a-b33c-3a7abd30c399 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:13.086236 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-99d5af8c-b552-431a-b33c-3a7abd30c399 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:13.087749 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-99d5af8c-b552-431a-b33c-3a7abd30c399 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:13.089381 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-99d5af8c-b552-431a-b33c-3a7abd30c399 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.153715 Jun 20 18:51:13.089934 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 332/649] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:12 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:14.107979 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6314345d-e403-4eff-976e-35ffbf1452f9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:14.108583 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6314345d-e403-4eff-976e-35ffbf1452f9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:14.115280 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6314345d-e403-4eff-976e-35ffbf1452f9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:14.115735 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6314345d-e403-4eff-976e-35ffbf1452f9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:14.116497 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6314345d-e403-4eff-976e-35ffbf1452f9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:14.116930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6314345d-e403-4eff-976e-35ffbf1452f9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:14.246144 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6314345d-e403-4eff-976e-35ffbf1452f9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:14.254400 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6314345d-e403-4eff-976e-35ffbf1452f9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:14.255918 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6314345d-e403-4eff-976e-35ffbf1452f9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:14.257048 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6314345d-e403-4eff-976e-35ffbf1452f9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.153588 Jun 20 18:51:14.257596 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 318/650] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:14 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:15.275511 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-17964926-2c5e-46ef-a550-4290890f6e1b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:15.276268 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-17964926-2c5e-46ef-a550-4290890f6e1b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:15.282856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-17964926-2c5e-46ef-a550-4290890f6e1b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:15.283329 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-17964926-2c5e-46ef-a550-4290890f6e1b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:15.284083 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-17964926-2c5e-46ef-a550-4290890f6e1b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:15.284514 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-17964926-2c5e-46ef-a550-4290890f6e1b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:15.411975 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-17964926-2c5e-46ef-a550-4290890f6e1b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:15.421054 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-17964926-2c5e-46ef-a550-4290890f6e1b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:15.422553 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-17964926-2c5e-46ef-a550-4290890f6e1b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:15.423728 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-17964926-2c5e-46ef-a550-4290890f6e1b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.152089 Jun 20 18:51:15.424284 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 333/651] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:15 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:16.442553 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-08c8f1fb-1e15-4ca9-a28e-4edc5b2970df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:16.443135 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-08c8f1fb-1e15-4ca9-a28e-4edc5b2970df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:16.449610 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-08c8f1fb-1e15-4ca9-a28e-4edc5b2970df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:16.450030 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-08c8f1fb-1e15-4ca9-a28e-4edc5b2970df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:16.450782 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-08c8f1fb-1e15-4ca9-a28e-4edc5b2970df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:16.451232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-08c8f1fb-1e15-4ca9-a28e-4edc5b2970df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:16.578879 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-08c8f1fb-1e15-4ca9-a28e-4edc5b2970df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:16.587212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-08c8f1fb-1e15-4ca9-a28e-4edc5b2970df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:16.588709 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-08c8f1fb-1e15-4ca9-a28e-4edc5b2970df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:16.590430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-08c8f1fb-1e15-4ca9-a28e-4edc5b2970df tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.151830 Jun 20 18:51:16.591006 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 319/652] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:16 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:17.608770 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fb28e057-6984-449f-80af-530178e96461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:17.609967 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fb28e057-6984-449f-80af-530178e96461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:17.616142 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb28e057-6984-449f-80af-530178e96461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:17.616586 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb28e057-6984-449f-80af-530178e96461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:17.617346 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb28e057-6984-449f-80af-530178e96461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:17.617779 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb28e057-6984-449f-80af-530178e96461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:17.823105 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fb28e057-6984-449f-80af-530178e96461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:17.831721 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fb28e057-6984-449f-80af-530178e96461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:17.833217 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fb28e057-6984-449f-80af-530178e96461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:17.834365 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fb28e057-6984-449f-80af-530178e96461 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.229746 Jun 20 18:51:17.835195 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 334/653] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:17 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:18.246594 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7304eca6-26b9-4e01-83df-247f8ed21e65 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:18.247130 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7304eca6-26b9-4e01-83df-247f8ed21e65 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:18.253592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7304eca6-26b9-4e01-83df-247f8ed21e65 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:18.254026 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7304eca6-26b9-4e01-83df-247f8ed21e65 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:18.254805 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7304eca6-26b9-4e01-83df-247f8ed21e65 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:18.255261 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7304eca6-26b9-4e01-83df-247f8ed21e65 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:18.280542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7304eca6-26b9-4e01-83df-247f8ed21e65 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:51:18.357375 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7304eca6-26b9-4e01-83df-247f8ed21e65 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "DELETE /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 204 len: 0 microversion: 2.1 time: 0.114334 Jun 20 18:51:18.361087 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 320/654] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:51:18 2022] DELETE /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:51:18.366024 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4f2f6648-0ac2-4cc6-b81c-2ae910d4fcda tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:18.366785 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-4f2f6648-0ac2-4cc6-b81c-2ae910d4fcda tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:18.370490 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=28 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:51:18.375027 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4f2f6648-0ac2-4cc6-b81c-2ae910d4fcda tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:18.375465 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4f2f6648-0ac2-4cc6-b81c-2ae910d4fcda tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:18.376217 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4f2f6648-0ac2-4cc6-b81c-2ae910d4fcda tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:18.376646 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4f2f6648-0ac2-4cc6-b81c-2ae910d4fcda tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:18.502658 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-4f2f6648-0ac2-4cc6-b81c-2ae910d4fcda tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:18.510096 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4f2f6648-0ac2-4cc6-b81c-2ae910d4fcda tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1514 microversion: 2.1 time: 0.147837 Jun 20 18:51:18.510663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 335/655] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:51:18 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:51:18.852697 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-35487aae-711e-4130-bb4c-c94972af7ce3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:18.853388 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-35487aae-711e-4130-bb4c-c94972af7ce3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:18.859332 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35487aae-711e-4130-bb4c-c94972af7ce3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:18.859778 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35487aae-711e-4130-bb4c-c94972af7ce3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:18.860538 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35487aae-711e-4130-bb4c-c94972af7ce3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:18.860969 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-35487aae-711e-4130-bb4c-c94972af7ce3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:18.986648 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-35487aae-711e-4130-bb4c-c94972af7ce3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:18.995056 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-35487aae-711e-4130-bb4c-c94972af7ce3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:18.996553 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-35487aae-711e-4130-bb4c-c94972af7ce3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:18.997701 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-35487aae-711e-4130-bb4c-c94972af7ce3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.149259 Jun 20 18:51:18.998263 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 321/656] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:18 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:19.527888 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a3ed9ad6-4b91-4af5-b48b-d9ca03aed0f0 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:19.528542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a3ed9ad6-4b91-4af5-b48b-d9ca03aed0f0 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:19.535233 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a3ed9ad6-4b91-4af5-b48b-d9ca03aed0f0 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:19.535682 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a3ed9ad6-4b91-4af5-b48b-d9ca03aed0f0 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:19.536442 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a3ed9ad6-4b91-4af5-b48b-d9ca03aed0f0 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:19.536876 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a3ed9ad6-4b91-4af5-b48b-d9ca03aed0f0 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:19.664811 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a3ed9ad6-4b91-4af5-b48b-d9ca03aed0f0 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:19.672182 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a3ed9ad6-4b91-4af5-b48b-d9ca03aed0f0 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1514 microversion: 2.1 time: 0.149014 Jun 20 18:51:19.672745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 336/657] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:51:19 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:51:20.016284 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-71330c20-c893-4037-9cdb-446dfee8138d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:20.016885 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-71330c20-c893-4037-9cdb-446dfee8138d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:20.023318 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-71330c20-c893-4037-9cdb-446dfee8138d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:20.023756 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-71330c20-c893-4037-9cdb-446dfee8138d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:20.024503 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-71330c20-c893-4037-9cdb-446dfee8138d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:20.024931 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-71330c20-c893-4037-9cdb-446dfee8138d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:20.156683 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-71330c20-c893-4037-9cdb-446dfee8138d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:20.165264 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-71330c20-c893-4037-9cdb-446dfee8138d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:20.166781 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-71330c20-c893-4037-9cdb-446dfee8138d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:20.167952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-71330c20-c893-4037-9cdb-446dfee8138d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.155597 Jun 20 18:51:20.168502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 322/658] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:20 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:51:20.689747 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4578e8b1-cf1e-44b2-be07-cb55d14fb0e9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:20.689747 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-4578e8b1-cf1e-44b2-be07-cb55d14fb0e9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:20.697304 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4578e8b1-cf1e-44b2-be07-cb55d14fb0e9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:20.697756 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4578e8b1-cf1e-44b2-be07-cb55d14fb0e9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:20.698530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4578e8b1-cf1e-44b2-be07-cb55d14fb0e9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:20.698988 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4578e8b1-cf1e-44b2-be07-cb55d14fb0e9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:21.180207 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-4578e8b1-cf1e-44b2-be07-cb55d14fb0e9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:21.186267 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-31b67df6-5ebd-4443-be82-4ee426976ae6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:21.187070 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-31b67df6-5ebd-4443-be82-4ee426976ae6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:21.189512 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4578e8b1-cf1e-44b2-be07-cb55d14fb0e9 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1514 microversion: 2.1 time: 0.504224 Jun 20 18:51:21.195021 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-31b67df6-5ebd-4443-be82-4ee426976ae6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:21.195021 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-31b67df6-5ebd-4443-be82-4ee426976ae6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:21.196950 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-31b67df6-5ebd-4443-be82-4ee426976ae6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:21.197402 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-31b67df6-5ebd-4443-be82-4ee426976ae6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:21.199563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 337/659] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:51:20 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1514 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:51:21.325185 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-31b67df6-5ebd-4443-be82-4ee426976ae6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:21.333703 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-31b67df6-5ebd-4443-be82-4ee426976ae6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:21.335219 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-31b67df6-5ebd-4443-be82-4ee426976ae6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:21.336363 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-31b67df6-5ebd-4443-be82-4ee426976ae6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.154632 Jun 20 18:51:21.336911 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 323/660] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:21 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:21.460143 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-87d2e4ea-9d5d-4852-aa7b-34188641b4b4 req-06a46c94-0289-4998-b445-c0c4c6ab9fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a4746c-b747-44dc-a25d-dc1ab9843931", "name": "network-vif-deleted", "tag": "b5c7bf4a-8f36-4140-a240-1ef39607c1c5"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:51:21.469324 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-87d2e4ea-9d5d-4852-aa7b-34188641b4b4 req-06a46c94-0289-4998-b445-c0c4c6ab9fee service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:21.469761 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-87d2e4ea-9d5d-4852-aa7b-34188641b4b4 req-06a46c94-0289-4998-b445-c0c4c6ab9fee service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:21.482420 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-87d2e4ea-9d5d-4852-aa7b-34188641b4b4 req-06a46c94-0289-4998-b445-c0c4c6ab9fee service nova] Creating event network-vif-deleted:b5c7bf4a-8f36-4140-a240-1ef39607c1c5 for instance 96a4746c-b747-44dc-a25d-dc1ab9843931 on hv-cinder-83697 Jun 20 18:51:21.487986 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-87d2e4ea-9d5d-4852-aa7b-34188641b4b4 req-06a46c94-0289-4998-b445-c0c4c6ab9fee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031471 Jun 20 18:51:21.491306 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 338/661] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:51:22.206743 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-509b1858-50da-4d97-95f9-fe6bf7d70692 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:22.207371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-509b1858-50da-4d97-95f9-fe6bf7d70692 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:22.213530 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-509b1858-50da-4d97-95f9-fe6bf7d70692 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:22.214482 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-509b1858-50da-4d97-95f9-fe6bf7d70692 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:22.215270 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-509b1858-50da-4d97-95f9-fe6bf7d70692 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:22.215702 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-509b1858-50da-4d97-95f9-fe6bf7d70692 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:22.245110 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-509b1858-50da-4d97-95f9-fe6bf7d70692 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:22.245551 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-509b1858-50da-4d97-95f9-fe6bf7d70692 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:22.245999 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-509b1858-50da-4d97-95f9-fe6bf7d70692 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lazy-loading 'fault' on Instance uuid 96a4746c-b747-44dc-a25d-dc1ab9843931 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:51:22.248706 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:51:22.290125 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-509b1858-50da-4d97-95f9-fe6bf7d70692 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:22.298167 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-509b1858-50da-4d97-95f9-fe6bf7d70692 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1309 microversion: 2.1 time: 0.095241 Jun 20 18:51:22.298725 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 324/662] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:51:22 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:51:22.356453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a4ec54d7-972f-4a51-b30e-cd690fdb8d57 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:22.357140 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a4ec54d7-972f-4a51-b30e-cd690fdb8d57 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:22.363726 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a4ec54d7-972f-4a51-b30e-cd690fdb8d57 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:22.364169 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a4ec54d7-972f-4a51-b30e-cd690fdb8d57 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:22.364914 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a4ec54d7-972f-4a51-b30e-cd690fdb8d57 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:22.365345 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a4ec54d7-972f-4a51-b30e-cd690fdb8d57 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:22.494490 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a4ec54d7-972f-4a51-b30e-cd690fdb8d57 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:22.503428 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a4ec54d7-972f-4a51-b30e-cd690fdb8d57 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:22.504913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a4ec54d7-972f-4a51-b30e-cd690fdb8d57 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:22.506047 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a4ec54d7-972f-4a51-b30e-cd690fdb8d57 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.154443 Jun 20 18:51:22.506599 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 339/663] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:22 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:23.320257 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a87be238-7d61-48e7-b0fe-2c0f32dddd0c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:23.320864 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a87be238-7d61-48e7-b0fe-2c0f32dddd0c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:23.327825 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a87be238-7d61-48e7-b0fe-2c0f32dddd0c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:23.328274 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a87be238-7d61-48e7-b0fe-2c0f32dddd0c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:23.329032 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a87be238-7d61-48e7-b0fe-2c0f32dddd0c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:23.329473 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a87be238-7d61-48e7-b0fe-2c0f32dddd0c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:23.359355 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a87be238-7d61-48e7-b0fe-2c0f32dddd0c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:23.359799 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a87be238-7d61-48e7-b0fe-2c0f32dddd0c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:23.360241 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-a87be238-7d61-48e7-b0fe-2c0f32dddd0c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lazy-loading 'fault' on Instance uuid 96a4746c-b747-44dc-a25d-dc1ab9843931 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:51:23.399133 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a87be238-7d61-48e7-b0fe-2c0f32dddd0c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e3a6db1a9b4c38bb8a5697ed08f8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d56a21c52b49ffbc838f590fe76d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:23.407064 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a87be238-7d61-48e7-b0fe-2c0f32dddd0c tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 200 len: 1309 microversion: 2.1 time: 0.090602 Jun 20 18:51:23.407619 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 325/664] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:51:23 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:51:23.524927 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c641ff0f-0ce9-41fa-95ce-8dfa52a60798 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:23.525525 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c641ff0f-0ce9-41fa-95ce-8dfa52a60798 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:23.532629 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c641ff0f-0ce9-41fa-95ce-8dfa52a60798 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:23.533069 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c641ff0f-0ce9-41fa-95ce-8dfa52a60798 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:23.533825 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c641ff0f-0ce9-41fa-95ce-8dfa52a60798 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:23.534256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c641ff0f-0ce9-41fa-95ce-8dfa52a60798 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:23.658476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c641ff0f-0ce9-41fa-95ce-8dfa52a60798 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:23.667079 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c641ff0f-0ce9-41fa-95ce-8dfa52a60798 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:23.668566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c641ff0f-0ce9-41fa-95ce-8dfa52a60798 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:23.669704 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c641ff0f-0ce9-41fa-95ce-8dfa52a60798 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.148728 Jun 20 18:51:23.670262 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 340/665] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:23 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:24.424071 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-dc47437f-5016-4e54-ad88-5d22f532af80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:24.424686 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-dc47437f-5016-4e54-ad88-5d22f532af80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] [instance: 96a4746c-b747-44dc-a25d-dc1ab9843931] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:24.431427 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dc47437f-5016-4e54-ad88-5d22f532af80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:24.431875 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dc47437f-5016-4e54-ad88-5d22f532af80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:24.433129 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dc47437f-5016-4e54-ad88-5d22f532af80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:24.433564 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dc47437f-5016-4e54-ad88-5d22f532af80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:24.446417 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-dc47437f-5016-4e54-ad88-5d22f532af80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] HTTP exception thrown: Instance 96a4746c-b747-44dc-a25d-dc1ab9843931 could not be found. Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-dc47437f-5016-4e54-ad88-5d22f532af80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Request method failure captured: Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 HTTP/1.1 Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMDb3_1uHEyhurn0QcPGo54yyBFseR2pcfVL-ONxzDHHWu2KECn6M3cWUtTBJsFL-R4EYs1itlf35mzHDoVUhxuF5ocLEHEYCTXBnmJRM-UadqmiD9yVx-V3VHeUnjDqwYhfUirWoDTbNrWE7UWAMeOfJv86iY3UHWIK_qhGgSz4vVo Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 98d56a21c52b49ffbc838f590fe76d29 Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1010800504 Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:51:24.448649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:51:24.450258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_98d56a21c52b49ffbc838f590fe76d29", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/98d56a21c52b49ffbc838f590fe76d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/98d56a21c52b49ffbc838f590fe76d29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/98d56a21c52b49ffbc838f590fe76d29"}]}] Jun 20 18:51:24.450258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-VolumesSnapshotTestJSON-1010800504 Jun 20 18:51:24.450258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 98d56a21c52b49ffbc838f590fe76d29 Jun 20 18:51:24.450258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1010800504 Jun 20 18:51:24.450258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-VolumesSnapshotTestJSON-1010800504-project Jun 20 18:51:24.450258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:51:24.450258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:51:24.450258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 27e3a6db1a9b4c38bb8a5697ed08f8e7 Jun 20 18:51:24.450258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-VolumesSnapshotTestJSON-1010800504-project Jun 20 18:51:24.450258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:51:24.450258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance 96a4746c-b747-44dc-a25d-dc1ab9843931 could not be found. Jun 20 18:51:24.450258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': '96a4746c-b747-44dc-a25d-dc1ab9843931'} Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a4746c-b747-44dc-a25d-dc1ab9843931 could not be found. Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:51:24.451103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a4746c-b747-44dc-a25d-dc1ab9843931 could not be found. Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a4746c-b747-44dc-a25d-dc1ab9843931 could not be found. Jun 20 18:51:24.452587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:51:24.453888 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-dc47437f-5016-4e54-ad88-5d22f532af80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] Returning 404 to user: Instance 96a4746c-b747-44dc-a25d-dc1ab9843931 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:51:24.453888 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-dc47437f-5016-4e54-ad88-5d22f532af80 tempest-VolumesSnapshotTestJSON-1010800504 tempest-VolumesSnapshotTestJSON-1010800504-project] 10.222.0.43 "GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931" status: 404 len: 111 microversion: 2.1 time: 0.029815 Jun 20 18:51:24.453888 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 326/666] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:51:24 2022] GET /compute/v2.1/servers/96a4746c-b747-44dc-a25d-dc1ab9843931 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:51:24.688300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-094c7f9d-5a8a-48e5-9132-340238e3aae7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:24.689137 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-094c7f9d-5a8a-48e5-9132-340238e3aae7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:24.695999 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-094c7f9d-5a8a-48e5-9132-340238e3aae7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:24.696627 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-094c7f9d-5a8a-48e5-9132-340238e3aae7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:24.697550 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-094c7f9d-5a8a-48e5-9132-340238e3aae7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:24.698084 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-094c7f9d-5a8a-48e5-9132-340238e3aae7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:24.830186 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-094c7f9d-5a8a-48e5-9132-340238e3aae7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:24.839847 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-094c7f9d-5a8a-48e5-9132-340238e3aae7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:24.841391 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-094c7f9d-5a8a-48e5-9132-340238e3aae7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:24.842553 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-094c7f9d-5a8a-48e5-9132-340238e3aae7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.158698 Jun 20 18:51:24.843153 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 341/667] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:24 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:25.860971 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e782158e-cf40-4726-9186-0e64d6b867d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:25.861633 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e782158e-cf40-4726-9186-0e64d6b867d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:25.868788 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e782158e-cf40-4726-9186-0e64d6b867d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:25.869227 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e782158e-cf40-4726-9186-0e64d6b867d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:25.870697 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e782158e-cf40-4726-9186-0e64d6b867d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:25.871161 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e782158e-cf40-4726-9186-0e64d6b867d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:26.007677 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e782158e-cf40-4726-9186-0e64d6b867d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:26.016210 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e782158e-cf40-4726-9186-0e64d6b867d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:26.017696 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e782158e-cf40-4726-9186-0e64d6b867d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:26.018841 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e782158e-cf40-4726-9186-0e64d6b867d1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.162350 Jun 20 18:51:26.019426 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 327/668] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:25 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:26.569430 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-9c3cfbca-a6ab-49e0-ae3c-05cfdf9141ea req-1d2e15fb-b507-46f2-b7f7-c72647bd80ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa52c387-5b77-4644-85c8-691b22dfeb78", "name": "network-vif-plugged", "status": "completed", "tag": "920abf72-084f-4d4e-be79-106c82668c67"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:51:26.579136 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-9c3cfbca-a6ab-49e0-ae3c-05cfdf9141ea req-1d2e15fb-b507-46f2-b7f7-c72647bd80ab service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:26.579735 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-9c3cfbca-a6ab-49e0-ae3c-05cfdf9141ea req-1d2e15fb-b507-46f2-b7f7-c72647bd80ab service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:26.591285 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-9c3cfbca-a6ab-49e0-ae3c-05cfdf9141ea req-1d2e15fb-b507-46f2-b7f7-c72647bd80ab service nova] Creating event network-vif-plugged:920abf72-084f-4d4e-be79-106c82668c67 for instance aa52c387-5b77-4644-85c8-691b22dfeb78 on hv-cinder-83697 Jun 20 18:51:26.596128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-9c3cfbca-a6ab-49e0-ae3c-05cfdf9141ea req-1d2e15fb-b507-46f2-b7f7-c72647bd80ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030288 Jun 20 18:51:26.596727 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 342/669] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:51:27.037266 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4a5d082a-86dc-42cb-9b31-f906eacd8b4e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:27.038031 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-4a5d082a-86dc-42cb-9b31-f906eacd8b4e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:27.045369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a5d082a-86dc-42cb-9b31-f906eacd8b4e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:27.045811 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a5d082a-86dc-42cb-9b31-f906eacd8b4e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:27.046566 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a5d082a-86dc-42cb-9b31-f906eacd8b4e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:27.047025 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a5d082a-86dc-42cb-9b31-f906eacd8b4e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:27.174774 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4a5d082a-86dc-42cb-9b31-f906eacd8b4e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:27.183668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4a5d082a-86dc-42cb-9b31-f906eacd8b4e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:27.185088 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4a5d082a-86dc-42cb-9b31-f906eacd8b4e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:27.186222 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4a5d082a-86dc-42cb-9b31-f906eacd8b4e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.152953 Jun 20 18:51:27.186775 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 328/670] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:27 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:28.205279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d1e74974-4336-4918-b667-ef267e9f55d8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:28.205959 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d1e74974-4336-4918-b667-ef267e9f55d8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:28.212180 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d1e74974-4336-4918-b667-ef267e9f55d8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:28.212621 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d1e74974-4336-4918-b667-ef267e9f55d8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:28.213957 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d1e74974-4336-4918-b667-ef267e9f55d8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:28.214377 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d1e74974-4336-4918-b667-ef267e9f55d8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:28.349237 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d1e74974-4336-4918-b667-ef267e9f55d8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:28.357522 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d1e74974-4336-4918-b667-ef267e9f55d8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:28.359026 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d1e74974-4336-4918-b667-ef267e9f55d8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:28.360160 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d1e74974-4336-4918-b667-ef267e9f55d8 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.159553 Jun 20 18:51:28.360706 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 343/671] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:28 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:29.378771 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-cf1fa868-217f-4e06-ac11-03a23afb88cb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:29.379474 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-cf1fa868-217f-4e06-ac11-03a23afb88cb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:29.386578 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cf1fa868-217f-4e06-ac11-03a23afb88cb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:29.387050 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cf1fa868-217f-4e06-ac11-03a23afb88cb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:29.387805 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cf1fa868-217f-4e06-ac11-03a23afb88cb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:29.388235 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cf1fa868-217f-4e06-ac11-03a23afb88cb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:29.517849 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cf1fa868-217f-4e06-ac11-03a23afb88cb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:29.526906 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cf1fa868-217f-4e06-ac11-03a23afb88cb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:29.528522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cf1fa868-217f-4e06-ac11-03a23afb88cb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:29.529755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-cf1fa868-217f-4e06-ac11-03a23afb88cb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.154996 Jun 20 18:51:29.530573 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 329/672] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:29 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:30.548135 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-53711162-3323-42a4-981d-a3d2acd0446b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:30.548743 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-53711162-3323-42a4-981d-a3d2acd0446b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:30.555289 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-53711162-3323-42a4-981d-a3d2acd0446b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:30.555735 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-53711162-3323-42a4-981d-a3d2acd0446b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:30.556586 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-53711162-3323-42a4-981d-a3d2acd0446b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:30.557050 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-53711162-3323-42a4-981d-a3d2acd0446b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:30.692065 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-53711162-3323-42a4-981d-a3d2acd0446b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:30.701617 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-53711162-3323-42a4-981d-a3d2acd0446b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:30.703167 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-53711162-3323-42a4-981d-a3d2acd0446b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:30.704337 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-53711162-3323-42a4-981d-a3d2acd0446b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.160072 Jun 20 18:51:30.704892 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 344/673] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:30 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:31.723397 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-25b1c63a-e537-43d3-87da-e12a0bcbd716 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:31.723997 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-25b1c63a-e537-43d3-87da-e12a0bcbd716 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:31.726279 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:51:31.731707 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-25b1c63a-e537-43d3-87da-e12a0bcbd716 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:31.732148 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-25b1c63a-e537-43d3-87da-e12a0bcbd716 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:31.732900 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-25b1c63a-e537-43d3-87da-e12a0bcbd716 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:31.733329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-25b1c63a-e537-43d3-87da-e12a0bcbd716 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:31.860786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-25b1c63a-e537-43d3-87da-e12a0bcbd716 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:31.869135 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-25b1c63a-e537-43d3-87da-e12a0bcbd716 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:31.871150 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-25b1c63a-e537-43d3-87da-e12a0bcbd716 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:31.872288 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-25b1c63a-e537-43d3-87da-e12a0bcbd716 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.152793 Jun 20 18:51:31.872831 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 330/674] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:31 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:32.890065 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0f362d54-e292-4a63-989a-0b93904c8d5d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:32.890719 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0f362d54-e292-4a63-989a-0b93904c8d5d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:32.897911 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0f362d54-e292-4a63-989a-0b93904c8d5d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:32.898359 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0f362d54-e292-4a63-989a-0b93904c8d5d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:32.899138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0f362d54-e292-4a63-989a-0b93904c8d5d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:32.899631 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0f362d54-e292-4a63-989a-0b93904c8d5d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:33.040814 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0f362d54-e292-4a63-989a-0b93904c8d5d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:33.049327 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0f362d54-e292-4a63-989a-0b93904c8d5d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:33.050870 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0f362d54-e292-4a63-989a-0b93904c8d5d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:33.052208 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0f362d54-e292-4a63-989a-0b93904c8d5d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.166111 Jun 20 18:51:33.052771 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 345/675] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:32 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:34.071190 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7fbbdef9-f1f4-4dd8-a541-1c6e4489988e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:34.071801 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7fbbdef9-f1f4-4dd8-a541-1c6e4489988e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:34.079746 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7fbbdef9-f1f4-4dd8-a541-1c6e4489988e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:34.079847 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7fbbdef9-f1f4-4dd8-a541-1c6e4489988e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:34.080557 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7fbbdef9-f1f4-4dd8-a541-1c6e4489988e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:34.080993 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7fbbdef9-f1f4-4dd8-a541-1c6e4489988e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:34.243038 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7fbbdef9-f1f4-4dd8-a541-1c6e4489988e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:34.252406 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7fbbdef9-f1f4-4dd8-a541-1c6e4489988e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:34.254020 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7fbbdef9-f1f4-4dd8-a541-1c6e4489988e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:34.255316 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7fbbdef9-f1f4-4dd8-a541-1c6e4489988e tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1809 microversion: 2.20 time: 0.188003 Jun 20 18:51:34.255961 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 331/676] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:34 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:51:35.273505 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a6e981b0-c1d8-4eba-a8f1-2641338f3b51 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:51:35.274013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a6e981b0-c1d8-4eba-a8f1-2641338f3b51 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:51:35.280432 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a6e981b0-c1d8-4eba-a8f1-2641338f3b51 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:35.280871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a6e981b0-c1d8-4eba-a8f1-2641338f3b51 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:35.281613 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a6e981b0-c1d8-4eba-a8f1-2641338f3b51 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:51:35.282038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a6e981b0-c1d8-4eba-a8f1-2641338f3b51 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:51:35.406388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a6e981b0-c1d8-4eba-a8f1-2641338f3b51 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:35.414965 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a6e981b0-c1d8-4eba-a8f1-2641338f3b51 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:35.416994 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a6e981b0-c1d8-4eba-a8f1-2641338f3b51 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:51:35.418124 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a6e981b0-c1d8-4eba-a8f1-2641338f3b51 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1796 microversion: 2.20 time: 0.148537 Jun 20 18:51:35.418663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 346/677] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:51:35 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1796 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:52:10.946889 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-11757858-b022-423c-9a32-98cc9eddf6e6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:52:10.947939 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-11757858-b022-423c-9a32-98cc9eddf6e6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:10.949991 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=3 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:10.950782 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=43 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:10.956676 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11757858-b022-423c-9a32-98cc9eddf6e6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:10.957127 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11757858-b022-423c-9a32-98cc9eddf6e6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:10.957891 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11757858-b022-423c-9a32-98cc9eddf6e6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:10.958325 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11757858-b022-423c-9a32-98cc9eddf6e6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:11.028897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-11757858-b022-423c-9a32-98cc9eddf6e6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "POST /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/action" status: 202 len: 0 microversion: 2.1 time: 0.085815 Jun 20 18:52:11.029541 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 332/678] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jun 20 18:52:10 2022] POST /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:52:11.037622 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-40c52fc8-fb17-4ff3-8303-f5b0399dd75b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:11.038477 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-40c52fc8-fb17-4ff3-8303-f5b0399dd75b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:11.042395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=23 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:11.043060 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=81 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:11.047257 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-40c52fc8-fb17-4ff3-8303-f5b0399dd75b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:11.047701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-40c52fc8-fb17-4ff3-8303-f5b0399dd75b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:11.048468 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-40c52fc8-fb17-4ff3-8303-f5b0399dd75b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:11.048897 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-40c52fc8-fb17-4ff3-8303-f5b0399dd75b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:11.282459 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-40c52fc8-fb17-4ff3-8303-f5b0399dd75b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:11.290647 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-40c52fc8-fb17-4ff3-8303-f5b0399dd75b tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1749 microversion: 2.1 time: 0.256983 Jun 20 18:52:11.291245 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 347/679] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:11 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1749 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:12.308736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6b613735-a348-4465-a5fd-853eeb8e6042 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:12.309431 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6b613735-a348-4465-a5fd-853eeb8e6042 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:12.316628 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6b613735-a348-4465-a5fd-853eeb8e6042 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:12.317074 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6b613735-a348-4465-a5fd-853eeb8e6042 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:12.318063 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6b613735-a348-4465-a5fd-853eeb8e6042 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:12.318417 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6b613735-a348-4465-a5fd-853eeb8e6042 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:12.458012 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6b613735-a348-4465-a5fd-853eeb8e6042 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:12.466415 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6b613735-a348-4465-a5fd-853eeb8e6042 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1754 microversion: 2.1 time: 0.162432 Jun 20 18:52:12.466998 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 333/680] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:12 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:13.484475 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c2e2b1db-728d-4dd9-a78c-0d2d5d9d2efe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:13.485086 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c2e2b1db-728d-4dd9-a78c-0d2d5d9d2efe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:13.491728 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2e2b1db-728d-4dd9-a78c-0d2d5d9d2efe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:13.492170 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2e2b1db-728d-4dd9-a78c-0d2d5d9d2efe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:13.492983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2e2b1db-728d-4dd9-a78c-0d2d5d9d2efe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:13.493433 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2e2b1db-728d-4dd9-a78c-0d2d5d9d2efe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:13.641168 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c2e2b1db-728d-4dd9-a78c-0d2d5d9d2efe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:13.648939 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c2e2b1db-728d-4dd9-a78c-0d2d5d9d2efe tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1754 microversion: 2.1 time: 0.168375 Jun 20 18:52:13.649496 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 348/681] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:13 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:14.665654 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-fdfe390f-c39e-41bc-8fb7-acf987f3c522 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:14.666278 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-fdfe390f-c39e-41bc-8fb7-acf987f3c522 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:14.672697 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fdfe390f-c39e-41bc-8fb7-acf987f3c522 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:14.673138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fdfe390f-c39e-41bc-8fb7-acf987f3c522 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:14.673886 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fdfe390f-c39e-41bc-8fb7-acf987f3c522 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:14.674312 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-fdfe390f-c39e-41bc-8fb7-acf987f3c522 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:14.815096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-fdfe390f-c39e-41bc-8fb7-acf987f3c522 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:14.823632 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-fdfe390f-c39e-41bc-8fb7-acf987f3c522 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1754 microversion: 2.1 time: 0.162079 Jun 20 18:52:14.824201 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 334/682] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:14 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:15.840639 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-22bcd177-2ff2-4b19-88c1-3372a8a3292a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:15.841243 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-22bcd177-2ff2-4b19-88c1-3372a8a3292a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:15.847714 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-22bcd177-2ff2-4b19-88c1-3372a8a3292a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:15.848156 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-22bcd177-2ff2-4b19-88c1-3372a8a3292a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:15.848909 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-22bcd177-2ff2-4b19-88c1-3372a8a3292a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:15.849341 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-22bcd177-2ff2-4b19-88c1-3372a8a3292a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:15.989056 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-22bcd177-2ff2-4b19-88c1-3372a8a3292a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:15.997537 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-22bcd177-2ff2-4b19-88c1-3372a8a3292a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1754 microversion: 2.1 time: 0.160847 Jun 20 18:52:15.998101 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 349/683] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:15 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:17.014873 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-824e30f7-7ed1-4994-8767-44a5b7d33b52 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:17.015501 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-824e30f7-7ed1-4994-8767-44a5b7d33b52 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:17.021862 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-824e30f7-7ed1-4994-8767-44a5b7d33b52 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:17.022300 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-824e30f7-7ed1-4994-8767-44a5b7d33b52 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:17.023073 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-824e30f7-7ed1-4994-8767-44a5b7d33b52 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:17.023502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-824e30f7-7ed1-4994-8767-44a5b7d33b52 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:17.161287 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-824e30f7-7ed1-4994-8767-44a5b7d33b52 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:17.169497 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-824e30f7-7ed1-4994-8767-44a5b7d33b52 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1754 microversion: 2.1 time: 0.158423 Jun 20 18:52:17.170044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 335/684] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:17 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:18.186398 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-56c17f10-edc0-4988-97c3-8d3ddfc77b82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:18.187047 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-56c17f10-edc0-4988-97c3-8d3ddfc77b82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:18.193763 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-56c17f10-edc0-4988-97c3-8d3ddfc77b82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:18.194198 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-56c17f10-edc0-4988-97c3-8d3ddfc77b82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:18.194988 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-56c17f10-edc0-4988-97c3-8d3ddfc77b82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:18.195416 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-56c17f10-edc0-4988-97c3-8d3ddfc77b82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:18.336828 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-56c17f10-edc0-4988-97c3-8d3ddfc77b82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:18.345267 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-56c17f10-edc0-4988-97c3-8d3ddfc77b82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1754 microversion: 2.1 time: 0.162793 Jun 20 18:52:18.345819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 350/685] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:18 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:19.361524 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-54a1fe24-781a-49e5-b398-86c93c59d4d5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:19.362133 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-54a1fe24-781a-49e5-b398-86c93c59d4d5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:19.368658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-54a1fe24-781a-49e5-b398-86c93c59d4d5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:19.369103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-54a1fe24-781a-49e5-b398-86c93c59d4d5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:19.369855 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-54a1fe24-781a-49e5-b398-86c93c59d4d5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:19.370289 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-54a1fe24-781a-49e5-b398-86c93c59d4d5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:19.510784 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-54a1fe24-781a-49e5-b398-86c93c59d4d5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:19.518649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-54a1fe24-781a-49e5-b398-86c93c59d4d5 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1754 microversion: 2.1 time: 0.161041 Jun 20 18:52:19.519243 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 336/686] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:19 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:20.536322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-131ec492-4522-4c0b-99f4-69fb1c9d04e0 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:20.536860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-131ec492-4522-4c0b-99f4-69fb1c9d04e0 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:20.543530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-131ec492-4522-4c0b-99f4-69fb1c9d04e0 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:20.543975 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-131ec492-4522-4c0b-99f4-69fb1c9d04e0 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:20.544727 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-131ec492-4522-4c0b-99f4-69fb1c9d04e0 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:20.545186 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-131ec492-4522-4c0b-99f4-69fb1c9d04e0 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:20.689599 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-131ec492-4522-4c0b-99f4-69fb1c9d04e0 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:20.697576 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-131ec492-4522-4c0b-99f4-69fb1c9d04e0 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1754 microversion: 2.1 time: 0.165282 Jun 20 18:52:20.698135 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 351/687] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:20 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:21.287317 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ce85ec9d-8989-4f5d-a5cf-0e547e65e8e0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:21.287809 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ce85ec9d-8989-4f5d-a5cf-0e547e65e8e0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:21.293981 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce85ec9d-8989-4f5d-a5cf-0e547e65e8e0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:21.294425 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce85ec9d-8989-4f5d-a5cf-0e547e65e8e0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:21.295208 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce85ec9d-8989-4f5d-a5cf-0e547e65e8e0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:21.295642 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce85ec9d-8989-4f5d-a5cf-0e547e65e8e0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:21.374316 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-ce85ec9d-8989-4f5d-a5cf-0e547e65e8e0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lazy-loading 'services' on Instance uuid 2614c08f-0c19-4066-8c87-551d4ac2f725 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:52:21.444367 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ce85ec9d-8989-4f5d-a5cf-0e547e65e8e0 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/os-volume_attachments/a8d36d3e-21e7-4e0b-a5b8-d4666ac391c4" status: 202 len: 0 microversion: 2.1 time: 0.374835 Jun 20 18:52:21.444968 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 337/688] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jun 20 18:52:21 2022] DELETE /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/os-volume_attachments/a8d36d3e-21e7-4e0b-a5b8-d4666ac391c4 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 18:52:21.715810 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ac83352f-194c-4ece-9f34-648faf297a82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:21.716335 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ac83352f-194c-4ece-9f34-648faf297a82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:21.722939 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ac83352f-194c-4ece-9f34-648faf297a82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:21.723391 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ac83352f-194c-4ece-9f34-648faf297a82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:21.724143 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ac83352f-194c-4ece-9f34-648faf297a82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:21.724574 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ac83352f-194c-4ece-9f34-648faf297a82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:21.865506 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ac83352f-194c-4ece-9f34-648faf297a82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:21.873923 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ac83352f-194c-4ece-9f34-648faf297a82 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1754 microversion: 2.1 time: 0.162095 Jun 20 18:52:21.874478 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 352/689] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:21 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:22.891933 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-86ec132b-fd9b-48eb-bb85-523f6ee8ada7 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:22.892623 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-86ec132b-fd9b-48eb-bb85-523f6ee8ada7 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:22.898942 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-86ec132b-fd9b-48eb-bb85-523f6ee8ada7 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:22.899401 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-86ec132b-fd9b-48eb-bb85-523f6ee8ada7 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:22.900177 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-86ec132b-fd9b-48eb-bb85-523f6ee8ada7 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:22.900605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-86ec132b-fd9b-48eb-bb85-523f6ee8ada7 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:23.045490 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-86ec132b-fd9b-48eb-bb85-523f6ee8ada7 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:23.053334 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-86ec132b-fd9b-48eb-bb85-523f6ee8ada7 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1754 microversion: 2.1 time: 0.166021 Jun 20 18:52:23.053886 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 338/690] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:22 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:23.611873 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e70bc6cf-aa0c-4b7a-af68-2cf400454815 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:52:23.618282 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e70bc6cf-aa0c-4b7a-af68-2cf400454815 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:23.618725 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e70bc6cf-aa0c-4b7a-af68-2cf400454815 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:23.677295 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e70bc6cf-aa0c-4b7a-af68-2cf400454815 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Going to try to stop instance {{(pid=124189) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 18:52:23.720510 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e70bc6cf-aa0c-4b7a-af68-2cf400454815 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "POST /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/action" status: 202 len: 0 microversion: 2.1 time: 0.112202 Jun 20 18:52:23.721157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 353/691] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jun 20 18:52:23 2022] POST /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:52:23.729848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-92eb2c98-22d1-42e5-a0d9-5c88be7ef88a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:23.730377 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-92eb2c98-22d1-42e5-a0d9-5c88be7ef88a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:23.736496 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-92eb2c98-22d1-42e5-a0d9-5c88be7ef88a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:23.736961 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-92eb2c98-22d1-42e5-a0d9-5c88be7ef88a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:23.737843 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-92eb2c98-22d1-42e5-a0d9-5c88be7ef88a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:23.738334 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-92eb2c98-22d1-42e5-a0d9-5c88be7ef88a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:23.863134 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-92eb2c98-22d1-42e5-a0d9-5c88be7ef88a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:23.871071 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-92eb2c98-22d1-42e5-a0d9-5c88be7ef88a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1676 microversion: 2.1 time: 0.145662 Jun 20 18:52:23.871626 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 339/692] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:23 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:24.071584 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-dcee39b8-f1d0-46b8-bd22-ce6a63b17372 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:24.072274 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-dcee39b8-f1d0-46b8-bd22-ce6a63b17372 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:24.078436 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-dcee39b8-f1d0-46b8-bd22-ce6a63b17372 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:24.078875 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-dcee39b8-f1d0-46b8-bd22-ce6a63b17372 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:24.079643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-dcee39b8-f1d0-46b8-bd22-ce6a63b17372 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:24.080067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-dcee39b8-f1d0-46b8-bd22-ce6a63b17372 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:24.220324 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-dcee39b8-f1d0-46b8-bd22-ce6a63b17372 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:24.228703 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-dcee39b8-f1d0-46b8-bd22-ce6a63b17372 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1754 microversion: 2.1 time: 0.161448 Jun 20 18:52:24.229255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 354/693] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:24 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:24.888575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-74dde603-0023-448c-a691-b16b29c329d9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:24.889159 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-74dde603-0023-448c-a691-b16b29c329d9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:24.895573 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-74dde603-0023-448c-a691-b16b29c329d9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:24.896019 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-74dde603-0023-448c-a691-b16b29c329d9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:24.896767 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-74dde603-0023-448c-a691-b16b29c329d9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:24.897195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-74dde603-0023-448c-a691-b16b29c329d9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:25.024191 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-74dde603-0023-448c-a691-b16b29c329d9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:25.032658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-74dde603-0023-448c-a691-b16b29c329d9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1676 microversion: 2.1 time: 0.147861 Jun 20 18:52:25.033231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 340/694] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:24 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:25.245938 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7d44ca25-1944-43ac-ba60-222ca0a1ab3a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:25.246550 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7d44ca25-1944-43ac-ba60-222ca0a1ab3a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:25.252983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7d44ca25-1944-43ac-ba60-222ca0a1ab3a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:25.253424 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7d44ca25-1944-43ac-ba60-222ca0a1ab3a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:25.254172 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7d44ca25-1944-43ac-ba60-222ca0a1ab3a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:25.254601 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7d44ca25-1944-43ac-ba60-222ca0a1ab3a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:25.394443 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7d44ca25-1944-43ac-ba60-222ca0a1ab3a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:25.402781 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7d44ca25-1944-43ac-ba60-222ca0a1ab3a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1754 microversion: 2.1 time: 0.161191 Jun 20 18:52:25.403384 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 355/695] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:25 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:26.050545 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-38910fa3-7c0f-4edf-baba-604dc0baac1c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:26.051248 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-38910fa3-7c0f-4edf-baba-604dc0baac1c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:26.058153 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-38910fa3-7c0f-4edf-baba-604dc0baac1c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:26.058602 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-38910fa3-7c0f-4edf-baba-604dc0baac1c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:26.059390 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-38910fa3-7c0f-4edf-baba-604dc0baac1c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:26.059825 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-38910fa3-7c0f-4edf-baba-604dc0baac1c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:26.185842 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-38910fa3-7c0f-4edf-baba-604dc0baac1c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:26.193313 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-38910fa3-7c0f-4edf-baba-604dc0baac1c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1676 microversion: 2.1 time: 0.146644 Jun 20 18:52:26.193869 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 341/696] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:26 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:26.419651 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f441504a-d793-42d2-bd29-af13d6dc6b68 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:26.420202 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f441504a-d793-42d2-bd29-af13d6dc6b68 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:26.426574 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f441504a-d793-42d2-bd29-af13d6dc6b68 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:26.427050 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f441504a-d793-42d2-bd29-af13d6dc6b68 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:26.427806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f441504a-d793-42d2-bd29-af13d6dc6b68 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:26.428255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f441504a-d793-42d2-bd29-af13d6dc6b68 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:26.570654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f441504a-d793-42d2-bd29-af13d6dc6b68 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:26.578563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f441504a-d793-42d2-bd29-af13d6dc6b68 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1754 microversion: 2.1 time: 0.163388 Jun 20 18:52:26.579147 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 356/697] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:26 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:52:27.210518 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a3a60ba3-0281-487a-b8fa-6503410dff92 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:27.211168 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a3a60ba3-0281-487a-b8fa-6503410dff92 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:27.218233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a3a60ba3-0281-487a-b8fa-6503410dff92 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:27.218680 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a3a60ba3-0281-487a-b8fa-6503410dff92 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:27.219474 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a3a60ba3-0281-487a-b8fa-6503410dff92 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:27.219909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a3a60ba3-0281-487a-b8fa-6503410dff92 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:27.343677 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a3a60ba3-0281-487a-b8fa-6503410dff92 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:27.351070 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a3a60ba3-0281-487a-b8fa-6503410dff92 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1676 microversion: 2.1 time: 0.144391 Jun 20 18:52:27.351626 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 342/698] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:27 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:27.595850 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0aad889a-0738-471e-92d1-00ab5fb2a809 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:27.596455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0aad889a-0738-471e-92d1-00ab5fb2a809 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:27.602990 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0aad889a-0738-471e-92d1-00ab5fb2a809 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:27.603438 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0aad889a-0738-471e-92d1-00ab5fb2a809 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:27.604237 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0aad889a-0738-471e-92d1-00ab5fb2a809 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:27.604670 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0aad889a-0738-471e-92d1-00ab5fb2a809 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:27.745311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0aad889a-0738-471e-92d1-00ab5fb2a809 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:27.753988 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0aad889a-0738-471e-92d1-00ab5fb2a809 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1754 microversion: 2.1 time: 0.161879 Jun 20 18:52:27.758373 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 357/699] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:27 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:28.368519 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-34198f55-2d7c-486e-8ca3-4d77996bb0de tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:28.369140 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-34198f55-2d7c-486e-8ca3-4d77996bb0de tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:28.375624 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-34198f55-2d7c-486e-8ca3-4d77996bb0de tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:28.376097 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-34198f55-2d7c-486e-8ca3-4d77996bb0de tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:28.376899 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-34198f55-2d7c-486e-8ca3-4d77996bb0de tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:28.377338 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-34198f55-2d7c-486e-8ca3-4d77996bb0de tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:28.505975 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-34198f55-2d7c-486e-8ca3-4d77996bb0de tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:28.513436 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-34198f55-2d7c-486e-8ca3-4d77996bb0de tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1676 microversion: 2.1 time: 0.149308 Jun 20 18:52:28.514033 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 343/700] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:28 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:52:28.770341 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3343559a-e4ff-4b8c-aad2-78c87344c843 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:28.770956 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-3343559a-e4ff-4b8c-aad2-78c87344c843 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:28.777511 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3343559a-e4ff-4b8c-aad2-78c87344c843 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:28.777949 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3343559a-e4ff-4b8c-aad2-78c87344c843 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:28.778691 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3343559a-e4ff-4b8c-aad2-78c87344c843 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:28.779150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3343559a-e4ff-4b8c-aad2-78c87344c843 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:28.921468 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-3343559a-e4ff-4b8c-aad2-78c87344c843 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:28.929279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-3343559a-e4ff-4b8c-aad2-78c87344c843 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1757 microversion: 2.1 time: 0.162762 Jun 20 18:52:28.929837 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 358/701] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:28 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:29.531213 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1010c817-ca3b-41ec-a92b-4f1d45485a5a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:29.531847 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1010c817-ca3b-41ec-a92b-4f1d45485a5a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:29.538268 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1010c817-ca3b-41ec-a92b-4f1d45485a5a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:29.538997 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1010c817-ca3b-41ec-a92b-4f1d45485a5a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:29.539755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1010c817-ca3b-41ec-a92b-4f1d45485a5a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:29.540182 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1010c817-ca3b-41ec-a92b-4f1d45485a5a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:29.667887 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-1010c817-ca3b-41ec-a92b-4f1d45485a5a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:29.675334 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1010c817-ca3b-41ec-a92b-4f1d45485a5a tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1676 microversion: 2.1 time: 0.147991 Jun 20 18:52:29.675910 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 344/702] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:29 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:30.692861 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a95c062a-79a9-4419-82be-f3261b9867e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:30.693422 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a95c062a-79a9-4419-82be-f3261b9867e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:30.699901 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a95c062a-79a9-4419-82be-f3261b9867e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:30.700341 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a95c062a-79a9-4419-82be-f3261b9867e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:30.701093 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a95c062a-79a9-4419-82be-f3261b9867e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:30.701524 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a95c062a-79a9-4419-82be-f3261b9867e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:30.827017 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a95c062a-79a9-4419-82be-f3261b9867e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:30.834323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a95c062a-79a9-4419-82be-f3261b9867e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1676 microversion: 2.1 time: 0.145403 Jun 20 18:52:30.834879 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 359/703] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:30 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:31.852040 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5ba5df05-6f52-4509-ab18-c7aafd65b8e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:31.853227 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5ba5df05-6f52-4509-ab18-c7aafd65b8e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:31.859885 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5ba5df05-6f52-4509-ab18-c7aafd65b8e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:31.860341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5ba5df05-6f52-4509-ab18-c7aafd65b8e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:31.861092 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5ba5df05-6f52-4509-ab18-c7aafd65b8e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:31.861527 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5ba5df05-6f52-4509-ab18-c7aafd65b8e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:31.988685 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5ba5df05-6f52-4509-ab18-c7aafd65b8e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:31.996241 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5ba5df05-6f52-4509-ab18-c7aafd65b8e4 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1676 microversion: 2.1 time: 0.148078 Jun 20 18:52:31.996805 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 345/704] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:31 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:33.013315 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1dea3659-2338-4ab9-9375-5a5921235e9d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:33.013918 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1dea3659-2338-4ab9-9375-5a5921235e9d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:33.020474 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1dea3659-2338-4ab9-9375-5a5921235e9d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:33.020919 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1dea3659-2338-4ab9-9375-5a5921235e9d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:33.021678 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1dea3659-2338-4ab9-9375-5a5921235e9d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:33.022112 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1dea3659-2338-4ab9-9375-5a5921235e9d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:33.150145 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1dea3659-2338-4ab9-9375-5a5921235e9d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:33.157474 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1dea3659-2338-4ab9-9375-5a5921235e9d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1676 microversion: 2.1 time: 0.148033 Jun 20 18:52:33.158063 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 360/705] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:33 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:34.175213 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-217653e4-08bf-469e-83a8-7bea81ecd613 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:34.175821 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-217653e4-08bf-469e-83a8-7bea81ecd613 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:34.182807 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-217653e4-08bf-469e-83a8-7bea81ecd613 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:34.183280 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-217653e4-08bf-469e-83a8-7bea81ecd613 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:34.184035 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-217653e4-08bf-469e-83a8-7bea81ecd613 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:34.184469 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-217653e4-08bf-469e-83a8-7bea81ecd613 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:34.313851 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-217653e4-08bf-469e-83a8-7bea81ecd613 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:34.317348 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:34.322642 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-217653e4-08bf-469e-83a8-7bea81ecd613 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1676 microversion: 2.1 time: 0.151307 Jun 20 18:52:34.323232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 346/706] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:34 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:35.340483 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-991cd71f-adaf-496a-ab9b-bf2b18bf3f0e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:35.341088 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-991cd71f-adaf-496a-ab9b-bf2b18bf3f0e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:35.347631 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-991cd71f-adaf-496a-ab9b-bf2b18bf3f0e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:35.348077 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-991cd71f-adaf-496a-ab9b-bf2b18bf3f0e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:35.348826 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-991cd71f-adaf-496a-ab9b-bf2b18bf3f0e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:35.349257 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-991cd71f-adaf-496a-ab9b-bf2b18bf3f0e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:35.473297 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-991cd71f-adaf-496a-ab9b-bf2b18bf3f0e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:35.481220 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-991cd71f-adaf-496a-ab9b-bf2b18bf3f0e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1653 microversion: 2.1 time: 0.145189 Jun 20 18:52:35.481781 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 361/707] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:35 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1653 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:35.498415 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7cf08c8c-5383-478d-b206-59e2d294f305 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:52:35.505904 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7cf08c8c-5383-478d-b206-59e2d294f305 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:35.506349 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7cf08c8c-5383-478d-b206-59e2d294f305 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:35.527526 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7cf08c8c-5383-478d-b206-59e2d294f305 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Going to try to start instance {{(pid=124190) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 18:52:35.568725 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7cf08c8c-5383-478d-b206-59e2d294f305 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "POST /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/action" status: 202 len: 0 microversion: 2.1 time: 0.075228 Jun 20 18:52:35.569340 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 347/708] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jun 20 18:52:35 2022] POST /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:52:35.577326 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f649ab70-efa5-4d7d-a37f-2bc7be95e2d1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:35.577931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f649ab70-efa5-4d7d-a37f-2bc7be95e2d1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:35.584105 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f649ab70-efa5-4d7d-a37f-2bc7be95e2d1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:35.584571 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f649ab70-efa5-4d7d-a37f-2bc7be95e2d1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:35.585307 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f649ab70-efa5-4d7d-a37f-2bc7be95e2d1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:35.585740 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f649ab70-efa5-4d7d-a37f-2bc7be95e2d1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:35.604737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:35.747530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f649ab70-efa5-4d7d-a37f-2bc7be95e2d1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:35.755359 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f649ab70-efa5-4d7d-a37f-2bc7be95e2d1 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1662 microversion: 2.1 time: 0.181716 Jun 20 18:52:35.755953 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 362/709] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:35 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1662 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:36.773866 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-abaa891f-2ac7-45fe-937b-0b4333d37fb6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:36.774553 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-abaa891f-2ac7-45fe-937b-0b4333d37fb6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:36.781320 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-abaa891f-2ac7-45fe-937b-0b4333d37fb6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:36.781759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-abaa891f-2ac7-45fe-937b-0b4333d37fb6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:36.782516 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-abaa891f-2ac7-45fe-937b-0b4333d37fb6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:36.782969 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-abaa891f-2ac7-45fe-937b-0b4333d37fb6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:36.811465 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4a429db0-267b-4c71-900e-22326dbb8b9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:36.812044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-4a429db0-267b-4c71-900e-22326dbb8b9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:36.818369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a429db0-267b-4c71-900e-22326dbb8b9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:36.818807 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a429db0-267b-4c71-900e-22326dbb8b9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:36.819587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a429db0-267b-4c71-900e-22326dbb8b9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:36.820014 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a429db0-267b-4c71-900e-22326dbb8b9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:36.844122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4a429db0-267b-4c71-900e-22326dbb8b9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86/ips" status: 200 len: 148 microversion: 2.1 time: 0.148503 Jun 20 18:52:36.844677 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 348/710] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jun 20 18:52:36 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86/ips => generated 148 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:52:36.856329 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a238b266-ab01-4c25-8bf1-aa5991e443aa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1221cdb8-8254-4493-9611-77278ace9eef"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:52:36.857446 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a238b266-ab01-4c25-8bf1-aa5991e443aa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:36.863409 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a238b266-ab01-4c25-8bf1-aa5991e443aa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:36.863947 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a238b266-ab01-4c25-8bf1-aa5991e443aa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:36.864719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a238b266-ab01-4c25-8bf1-aa5991e443aa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:36.865155 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a238b266-ab01-4c25-8bf1-aa5991e443aa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:36.919874 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-abaa891f-2ac7-45fe-937b-0b4333d37fb6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:36.927346 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-abaa891f-2ac7-45fe-937b-0b4333d37fb6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1666 microversion: 2.1 time: 0.158463 Jun 20 18:52:36.927903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 363/711] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:36 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:52:36.944359 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-a238b266-ab01-4c25-8bf1-aa5991e443aa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] HTTP exception thrown: Invalid volume: volume 1221cdb8-8254-4493-9611-77278ace9eef is already attached to instances: bf3d4888-1358-407b-9677-a8887d92ea3a Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a238b266-ab01-4c25-8bf1-aa5991e443aa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Request method failure captured: Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: POST /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86/os-volume_attachments HTTP/1.1 Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 74 Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMB7oKpb5ufs7k91aATNwQ9lBCFsAiscF2D6zDu63Pdu1lDJfudYPQfg-WIoWYQQ-JgV04sOxsJj7QlSIQrKVCkKsbiXYH3d8jdfXZNL0OxCyUpor2PA81B48M0Ll8y0cg4uK3b5-fQlEg3o6bUpvXP-E4SmBiu6KFl4dytZBttHh-M Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:52:36.946554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:52:36.948160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8006d78bc1604611b3254b5efa451288", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8006d78bc1604611b3254b5efa451288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}] Jun 20 18:52:36.948160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:52:36.948160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:52:36.948160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:52:36.948160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:52:36.948160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:52:36.948160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:52:36.948160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: c3134832f2a647aab761da347f7e9fd4 Jun 20 18:52:36.948160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:52:36.948160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Jun 20 18:52:36.948160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {"volumeAttachment": {"volumeId": "1221cdb8-8254-4493-9611-77278ace9eef"}} Jun 20 18:52:36.948160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Invalid volume: volume 1221cdb8-8254-4493-9611-77278ace9eef is already attached to instances: bf3d4888-1358-407b-9677-a8887d92ea3a Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'server_id': '6efd07f2-b56d-4cc1-8187-d6d3afca2c86', 'body': {'volumeAttachment': {'volumeId': '1221cdb8-8254-4493-9611-77278ace9eef'}}} Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1221cdb8-8254-4493-9611-77278ace9eef is already attached to instances: bf3d4888-1358-407b-9677-a8887d92ea3a Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:52:36.949009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1221cdb8-8254-4493-9611-77278ace9eef is already attached to instances: bf3d4888-1358-407b-9677-a8887d92ea3a Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:52:36.950217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:52:36.951574 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:52:36.951574 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:52:36.951574 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:52:36.951574 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1221cdb8-8254-4493-9611-77278ace9eef is already attached to instances: bf3d4888-1358-407b-9677-a8887d92ea3a Jun 20 18:52:36.951574 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:52:36.951574 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a238b266-ab01-4c25-8bf1-aa5991e443aa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Returning 400 to user: Invalid volume: volume 1221cdb8-8254-4493-9611-77278ace9eef is already attached to instances: bf3d4888-1358-407b-9677-a8887d92ea3a {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:52:36.951574 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a238b266-ab01-4c25-8bf1-aa5991e443aa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "POST /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095905 Jun 20 18:52:36.951574 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 349/712] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jun 20 18:52:36 2022] POST /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 18:52:36.956709 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-466e3d3e-c50b-476d-9bbe-07d2d1a55309 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:36.957137 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-466e3d3e-c50b-476d-9bbe-07d2d1a55309 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:36.963621 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-466e3d3e-c50b-476d-9bbe-07d2d1a55309 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:36.964086 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-466e3d3e-c50b-476d-9bbe-07d2d1a55309 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:36.964833 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-466e3d3e-c50b-476d-9bbe-07d2d1a55309 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:36.965260 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-466e3d3e-c50b-476d-9bbe-07d2d1a55309 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:36.988533 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-466e3d3e-c50b-476d-9bbe-07d2d1a55309 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Going to try to terminate instance {{(pid=124189) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:52:37.069035 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-466e3d3e-c50b-476d-9bbe-07d2d1a55309 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 204 len: 0 microversion: 2.1 time: 0.115897 Jun 20 18:52:37.069666 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 364/713] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:52:36 2022] DELETE /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:52:37.078127 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-edff3dba-47ac-4588-9d93-f1e873198d58 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:37.078764 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-edff3dba-47ac-4588-9d93-f1e873198d58 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:37.085503 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-edff3dba-47ac-4588-9d93-f1e873198d58 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:37.085943 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-edff3dba-47ac-4588-9d93-f1e873198d58 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:37.087336 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-edff3dba-47ac-4588-9d93-f1e873198d58 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:37.087770 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-edff3dba-47ac-4588-9d93-f1e873198d58 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:37.217264 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-edff3dba-47ac-4588-9d93-f1e873198d58 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:37.224724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-edff3dba-47ac-4588-9d93-f1e873198d58 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1681 microversion: 2.1 time: 0.150386 Jun 20 18:52:37.225465 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 350/714] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:37 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:38.242495 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-cb261899-4efe-4667-885e-cd3e42c61aae tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:38.243756 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-cb261899-4efe-4667-885e-cd3e42c61aae tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:38.250146 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cb261899-4efe-4667-885e-cd3e42c61aae tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:38.250587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cb261899-4efe-4667-885e-cd3e42c61aae tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:38.251370 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cb261899-4efe-4667-885e-cd3e42c61aae tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:38.251800 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cb261899-4efe-4667-885e-cd3e42c61aae tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:38.377831 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-cb261899-4efe-4667-885e-cd3e42c61aae tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:38.385672 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-cb261899-4efe-4667-885e-cd3e42c61aae tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1681 microversion: 2.1 time: 0.147379 Jun 20 18:52:38.386237 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 365/715] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:38 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:39.402971 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-caf806c0-c32f-4df3-a8e1-e4f441395d96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:39.404233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-caf806c0-c32f-4df3-a8e1-e4f441395d96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:39.410802 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-caf806c0-c32f-4df3-a8e1-e4f441395d96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:39.411282 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-caf806c0-c32f-4df3-a8e1-e4f441395d96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:39.412046 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-caf806c0-c32f-4df3-a8e1-e4f441395d96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:39.412474 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-caf806c0-c32f-4df3-a8e1-e4f441395d96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:39.542528 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-caf806c0-c32f-4df3-a8e1-e4f441395d96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:39.549937 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-caf806c0-c32f-4df3-a8e1-e4f441395d96 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1681 microversion: 2.1 time: 0.150866 Jun 20 18:52:39.550535 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 351/716] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:39 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:40.261889 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-f924a42d-3090-4f01-a797-2e01c45cdabf req-e82a29ae-5db0-4569-81f1-a4d47c554af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6efd07f2-b56d-4cc1-8187-d6d3afca2c86", "name": "network-vif-deleted", "tag": "28f8401e-b1a6-48d5-8f19-cf2b25578a52"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:52:40.272059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-f924a42d-3090-4f01-a797-2e01c45cdabf req-e82a29ae-5db0-4569-81f1-a4d47c554af9 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:40.272797 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-f924a42d-3090-4f01-a797-2e01c45cdabf req-e82a29ae-5db0-4569-81f1-a4d47c554af9 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:40.287425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-f924a42d-3090-4f01-a797-2e01c45cdabf req-e82a29ae-5db0-4569-81f1-a4d47c554af9 service nova] Creating event network-vif-deleted:28f8401e-b1a6-48d5-8f19-cf2b25578a52 for instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 on hv-cinder-83697 Jun 20 18:52:40.294259 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-f924a42d-3090-4f01-a797-2e01c45cdabf req-e82a29ae-5db0-4569-81f1-a4d47c554af9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107521 Jun 20 18:52:40.294868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 366/717] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:52:40.567390 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-94fc899c-8ad9-4e1f-805f-63b9f53413a2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:40.568005 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-94fc899c-8ad9-4e1f-805f-63b9f53413a2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:40.575409 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-94fc899c-8ad9-4e1f-805f-63b9f53413a2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:40.575864 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-94fc899c-8ad9-4e1f-805f-63b9f53413a2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:40.576661 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-94fc899c-8ad9-4e1f-805f-63b9f53413a2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:40.577100 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-94fc899c-8ad9-4e1f-805f-63b9f53413a2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:40.609525 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-94fc899c-8ad9-4e1f-805f-63b9f53413a2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:40.609993 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-94fc899c-8ad9-4e1f-805f-63b9f53413a2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:40.610436 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-94fc899c-8ad9-4e1f-805f-63b9f53413a2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lazy-loading 'fault' on Instance uuid 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:52:40.654166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-94fc899c-8ad9-4e1f-805f-63b9f53413a2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:40.661805 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-94fc899c-8ad9-4e1f-805f-63b9f53413a2 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 200 len: 1332 microversion: 2.1 time: 0.098634 Jun 20 18:52:40.662566 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 352/718] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:40 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:41.680519 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-99147d2a-7957-4a83-87dd-a044dd73f81e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:41.681208 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-99147d2a-7957-4a83-87dd-a044dd73f81e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:41.683623 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:41.689073 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-99147d2a-7957-4a83-87dd-a044dd73f81e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:41.689523 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-99147d2a-7957-4a83-87dd-a044dd73f81e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:41.690274 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-99147d2a-7957-4a83-87dd-a044dd73f81e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:41.690697 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-99147d2a-7957-4a83-87dd-a044dd73f81e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:41.704957 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-99147d2a-7957-4a83-87dd-a044dd73f81e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] HTTP exception thrown: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-99147d2a-7957-4a83-87dd-a044dd73f81e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Request method failure captured: Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 HTTP/1.1 Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMB7oKpb5ufs7k91aATNwQ9lBCFsAiscF2D6zDu63Pdu1lDJfudYPQfg-WIoWYQQ-JgV04sOxsJj7QlSIQrKVCkKsbiXYH3d8jdfXZNL0OxCyUpor2PA81B48M0Ll8y0cg4uK3b5-fQlEg3o6bUpvXP-E4SmBiu6KFl4dytZBttHh-M Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:52:41.706700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:52:41.708246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8006d78bc1604611b3254b5efa451288", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8006d78bc1604611b3254b5efa451288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}] Jun 20 18:52:41.708246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:52:41.708246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:52:41.708246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:52:41.708246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:52:41.708246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:52:41.708246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:52:41.708246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: c3134832f2a647aab761da347f7e9fd4 Jun 20 18:52:41.708246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:52:41.708246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:52:41.708246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:52:41.708246 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '6efd07f2-b56d-4cc1-8187-d6d3afca2c86'} Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:52:41.709222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:52:41.710745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:52:41.712686 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-99147d2a-7957-4a83-87dd-a044dd73f81e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Returning 404 to user: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:52:41.712686 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-99147d2a-7957-4a83-87dd-a044dd73f81e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 404 len: 111 microversion: 2.1 time: 0.031740 Jun 20 18:52:41.712686 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 367/719] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:41 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:52:41.717741 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d6e48848-9f8f-4b09-b50e-244c26812516 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '.version_select at 0x7f7e491ed790>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:41.723652 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=45 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:41.737223 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d6e48848-9f8f-4b09-b50e-244c26812516 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874364346" status: 202 len: 0 microversion: 2.1 time: 0.023385 Jun 20 18:52:41.737788 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 353/720] 10.222.0.43 () {58 vars in 1220 bytes} [Mon Jun 20 18:52:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874364346 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:52:42.362946 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1bed04e4-db66-4c66-a2a7-635db7f3d37c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:42.363450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1bed04e4-db66-4c66-a2a7-635db7f3d37c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:42.369912 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1bed04e4-db66-4c66-a2a7-635db7f3d37c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:42.370353 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1bed04e4-db66-4c66-a2a7-635db7f3d37c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:42.371158 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1bed04e4-db66-4c66-a2a7-635db7f3d37c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:42.371596 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1bed04e4-db66-4c66-a2a7-635db7f3d37c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:42.451637 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-1bed04e4-db66-4c66-a2a7-635db7f3d37c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lazy-loading 'services' on Instance uuid bf3d4888-1358-407b-9677-a8887d92ea3a {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:52:42.521415 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1bed04e4-db66-4c66-a2a7-635db7f3d37c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a/os-volume_attachments/1221cdb8-8254-4493-9611-77278ace9eef" status: 202 len: 0 microversion: 2.1 time: 0.162276 Jun 20 18:52:42.521987 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 368/721] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jun 20 18:52:42 2022] DELETE /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a/os-volume_attachments/1221cdb8-8254-4493-9611-77278ace9eef => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:52:42.530577 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c02166a9-ccd7-47e8-899e-f51b717be4a8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:42.531458 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c02166a9-ccd7-47e8-899e-f51b717be4a8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:42.538303 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c02166a9-ccd7-47e8-899e-f51b717be4a8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:42.539073 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c02166a9-ccd7-47e8-899e-f51b717be4a8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:42.539818 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c02166a9-ccd7-47e8-899e-f51b717be4a8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:42.540252 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c02166a9-ccd7-47e8-899e-f51b717be4a8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:42.569448 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c02166a9-ccd7-47e8-899e-f51b717be4a8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043158 Jun 20 18:52:42.569989 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 354/722] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:52:42 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:52:43.582397 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-73548d37-46c5-42e4-a495-4d63d74fc11b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:43.583425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-73548d37-46c5-42e4-a495-4d63d74fc11b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:43.590652 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-73548d37-46c5-42e4-a495-4d63d74fc11b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:43.591139 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-73548d37-46c5-42e4-a495-4d63d74fc11b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:43.592034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-73548d37-46c5-42e4-a495-4d63d74fc11b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:43.592469 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-73548d37-46c5-42e4-a495-4d63d74fc11b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:43.627462 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-73548d37-46c5-42e4-a495-4d63d74fc11b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050023 Jun 20 18:52:43.628017 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 369/723] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:52:43 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 18:52:43.686057 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-68f58d51-6dcb-4d78-8ce2-9a21178dc4fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:43.686563 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-68f58d51-6dcb-4d78-8ce2-9a21178dc4fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:43.693480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-68f58d51-6dcb-4d78-8ce2-9a21178dc4fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:43.694090 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-68f58d51-6dcb-4d78-8ce2-9a21178dc4fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:43.694908 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-68f58d51-6dcb-4d78-8ce2-9a21178dc4fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:43.695463 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-68f58d51-6dcb-4d78-8ce2-9a21178dc4fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:43.722246 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-68f58d51-6dcb-4d78-8ce2-9a21178dc4fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:52:43.796297 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-68f58d51-6dcb-4d78-8ce2-9a21178dc4fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 204 len: 0 microversion: 2.1 time: 0.113645 Jun 20 18:52:43.797087 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 355/724] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:52:43 2022] DELETE /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:52:43.808002 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c1fabd73-7e03-449b-ab94-fff040838eac tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:43.808616 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c1fabd73-7e03-449b-ab94-fff040838eac tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:43.814784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c1fabd73-7e03-449b-ab94-fff040838eac tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:43.815291 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c1fabd73-7e03-449b-ab94-fff040838eac tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:43.816051 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c1fabd73-7e03-449b-ab94-fff040838eac tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:43.816488 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c1fabd73-7e03-449b-ab94-fff040838eac tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:43.947172 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c1fabd73-7e03-449b-ab94-fff040838eac tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:43.954578 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c1fabd73-7e03-449b-ab94-fff040838eac tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1678 microversion: 2.1 time: 0.153084 Jun 20 18:52:43.955183 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 370/725] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:43 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:44.972492 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ce9bd1cc-759d-404a-9667-04685fc765c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:44.973106 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ce9bd1cc-759d-404a-9667-04685fc765c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:44.980282 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce9bd1cc-759d-404a-9667-04685fc765c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:44.980724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce9bd1cc-759d-404a-9667-04685fc765c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:44.981475 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce9bd1cc-759d-404a-9667-04685fc765c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:44.981904 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce9bd1cc-759d-404a-9667-04685fc765c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:45.112116 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ce9bd1cc-759d-404a-9667-04685fc765c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:45.119772 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ce9bd1cc-759d-404a-9667-04685fc765c9 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1678 microversion: 2.1 time: 0.151570 Jun 20 18:52:45.120338 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 356/726] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:44 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:45.180098 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-52b03da1-6e92-4198-b907-3458543094ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1da1cc46-7bd5-493f-b9c1-10b923921701"}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:52:45.181941 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-52b03da1-6e92-4198-b907-3458543094ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:45.188490 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-52b03da1-6e92-4198-b907-3458543094ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:45.189007 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-52b03da1-6e92-4198-b907-3458543094ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:45.189825 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-52b03da1-6e92-4198-b907-3458543094ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:45.190322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-52b03da1-6e92-4198-b907-3458543094ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:45.452977 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-52b03da1-6e92-4198-b907-3458543094ef tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "POST /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276323 Jun 20 18:52:45.453792 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 371/727] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jun 20 18:52:45 2022] POST /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:52:46.052568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-60e06560-85e7-4d13-a83b-eca383f9e049 req-7df92589-65ec-4816-be29-5f977bb49aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3d4888-1358-407b-9677-a8887d92ea3a", "name": "network-vif-deleted", "tag": "2f87729e-9bda-4418-ae91-a86c8903e7f2"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:52:46.064414 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-60e06560-85e7-4d13-a83b-eca383f9e049 req-7df92589-65ec-4816-be29-5f977bb49aac service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:46.065013 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-60e06560-85e7-4d13-a83b-eca383f9e049 req-7df92589-65ec-4816-be29-5f977bb49aac service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:46.082427 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-60e06560-85e7-4d13-a83b-eca383f9e049 req-7df92589-65ec-4816-be29-5f977bb49aac service nova] Creating event network-vif-deleted:2f87729e-9bda-4418-ae91-a86c8903e7f2 for instance bf3d4888-1358-407b-9677-a8887d92ea3a on hv-cinder-83697 Jun 20 18:52:46.090978 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-60e06560-85e7-4d13-a83b-eca383f9e049 req-7df92589-65ec-4816-be29-5f977bb49aac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042478 Jun 20 18:52:46.091647 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 357/728] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:52:46.138989 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0ad85b95-7a85-4a7c-aaac-6d70b3e08ff0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:46.139694 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0ad85b95-7a85-4a7c-aaac-6d70b3e08ff0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:46.153572 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ad85b95-7a85-4a7c-aaac-6d70b3e08ff0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:46.153994 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ad85b95-7a85-4a7c-aaac-6d70b3e08ff0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:46.154772 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ad85b95-7a85-4a7c-aaac-6d70b3e08ff0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:46.155233 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0ad85b95-7a85-4a7c-aaac-6d70b3e08ff0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:46.235559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0ad85b95-7a85-4a7c-aaac-6d70b3e08ff0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:46.244088 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0ad85b95-7a85-4a7c-aaac-6d70b3e08ff0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 200 len: 1324 microversion: 2.1 time: 0.109386 Jun 20 18:52:46.246310 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 372/729] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:46 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 1324 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:47.263163 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a6631980-d3ff-47ca-910e-b66540d7e2e7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:47.263886 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a6631980-d3ff-47ca-910e-b66540d7e2e7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:47.270501 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a6631980-d3ff-47ca-910e-b66540d7e2e7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:47.270971 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a6631980-d3ff-47ca-910e-b66540d7e2e7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:47.271725 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a6631980-d3ff-47ca-910e-b66540d7e2e7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:47.272156 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a6631980-d3ff-47ca-910e-b66540d7e2e7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:47.284964 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-a6631980-d3ff-47ca-910e-b66540d7e2e7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] HTTP exception thrown: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a6631980-d3ff-47ca-910e-b66540d7e2e7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Request method failure captured: Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a HTTP/1.1 Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMB7oKpb5ufs7k91aATNwQ9lBCFsAiscF2D6zDu63Pdu1lDJfudYPQfg-WIoWYQQ-JgV04sOxsJj7QlSIQrKVCkKsbiXYH3d8jdfXZNL0OxCyUpor2PA81B48M0Ll8y0cg4uK3b5-fQlEg3o6bUpvXP-E4SmBiu6KFl4dytZBttHh-M Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:52:47.286542 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:52:47.288090 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8006d78bc1604611b3254b5efa451288", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8006d78bc1604611b3254b5efa451288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}] Jun 20 18:52:47.288090 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:52:47.288090 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:52:47.288090 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:52:47.288090 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:52:47.288090 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:52:47.288090 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:52:47.288090 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: c3134832f2a647aab761da347f7e9fd4 Jun 20 18:52:47.288090 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:52:47.288090 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:52:47.288090 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:52:47.288090 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': 'bf3d4888-1358-407b-9677-a8887d92ea3a'} Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:52:47.289231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:52:47.291256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:52:47.292787 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a6631980-d3ff-47ca-910e-b66540d7e2e7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Returning 404 to user: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:52:47.292787 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a6631980-d3ff-47ca-910e-b66540d7e2e7 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 404 len: 111 microversion: 2.1 time: 0.028958 Jun 20 18:52:47.292787 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 358/730] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:47 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:52:47.297237 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-37bbd2e0-b6ba-405d-98e7-6d603c6e3840 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '.version_select at 0x7f7e44861ca0>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:47.316152 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-37bbd2e0-b6ba-405d-98e7-6d603c6e3840 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-595114772" status: 202 len: 0 microversion: 2.1 time: 0.022637 Jun 20 18:52:47.316714 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 373/731] 10.222.0.43 () {58 vars in 1217 bytes} [Mon Jun 20 18:52:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-595114772 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:52:47.938613 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b102ab62-24c2-4845-a135-8f3aebcb603b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Action: 'create', calling method: .version_select at 0x7f7e49134280>, body: {"keypair": {"name": "tempest-keypair-806128802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbh7D9ChW73pYmV+Pa5kxBZZyQr8VP3M5Do8a1zH4kYeIhbRDKlGuw1EkjSIrWCiJANlbqH7sXIZZKtyrMtV4NnIY8JoDLknfyMnoeZ2oLDuOVXqzS4dp5MNWsCy9DcOA=="}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:52:47.952030 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-b102ab62-24c2-4845-a135-8f3aebcb603b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for project 8006d78bc1604611b3254b5efa451288. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:52:47.955741 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-b102ab62-24c2-4845-a135-8f3aebcb603b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for user c3134832f2a647aab761da347f7e9fd4 and project 8006d78bc1604611b3254b5efa451288. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:52:47.977956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b102ab62-24c2-4845-a135-8f3aebcb603b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.042792 Jun 20 18:52:47.978977 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 359/732] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jun 20 18:52:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:52:49.099298 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2085535010", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26505b1c-460a-483f-99b8-daa82e0cee5d"}], "security_groups": [{"name": "tempest-securitygroup--1681360139"}], "key_name": "tempest-keypair-806128802", "user_data": "}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:52:49.198662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.network.neutron [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] validate_networks() for [('26505b1c-460a-483f-99b8-daa82e0cee5d', None, None, None, None, None)] {{(pid=124189) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:52:49.645498 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Flavor limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:52:49.645922 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Image limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:52:49.646396 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Flavor pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:52:49.646832 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Image pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:52:49.647265 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:52:49.656592 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:49.657042 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:49.657842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:49.658276 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:49.675804 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for project 8006d78bc1604611b3254b5efa451288. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:52:49.679772 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for user c3134832f2a647aab761da347f7e9fd4 and project 8006d78bc1604611b3254b5efa451288. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:52:49.690577 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Going to run 1 instances... {{(pid=124189) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:52:49.692834 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124189) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:52:49.739325 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [d1eaffad-b131-43a9-904f-fd46bf4207bc] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 18:52:50.747383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [d1eaffad-b131-43a9-904f-fd46bf4207bc] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 54066. Jun 20 18:52:50.751182 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4b65fc7d-eeb6-4a64-ae8f-e9e35589e4ed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.656739 Jun 20 18:52:50.751837 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 374/733] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:52:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:52:50.762859 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5e7ea3fd-e938-42d7-8da2-abd06b284634 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:50.763530 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5e7ea3fd-e938-42d7-8da2-abd06b284634 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:50.816743 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5e7ea3fd-e938-42d7-8da2-abd06b284634 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:50.825216 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5e7ea3fd-e938-42d7-8da2-abd06b284634 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1241 microversion: 2.1 time: 0.067299 Jun 20 18:52:50.825760 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 360/734] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:50 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:51.843429 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-cb6a8708-fd0d-4efb-82aa-778cc3b8b04a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:51.844079 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-cb6a8708-fd0d-4efb-82aa-778cc3b8b04a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:51.898353 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-cb6a8708-fd0d-4efb-82aa-778cc3b8b04a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:51.905660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-cb6a8708-fd0d-4efb-82aa-778cc3b8b04a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1241 microversion: 2.1 time: 0.066653 Jun 20 18:52:51.906210 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 375/735] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:51 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:52.090502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e3ae39de-43f2-4b17-8c77-02b5809631c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:52.091030 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e3ae39de-43f2-4b17-8c77-02b5809631c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:52.096956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e3ae39de-43f2-4b17-8c77-02b5809631c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:52.097409 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e3ae39de-43f2-4b17-8c77-02b5809631c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:52.098168 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e3ae39de-43f2-4b17-8c77-02b5809631c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:52.098631 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e3ae39de-43f2-4b17-8c77-02b5809631c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:52.126553 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e3ae39de-43f2-4b17-8c77-02b5809631c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/os-volume_attachments/ed9e77b4-e4cd-43a8-8806-379e34217797" status: 200 len: 194 microversion: 2.20 time: 0.040837 Jun 20 18:52:52.127147 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 361/736] 10.222.0.43 () {60 vars in 1453 bytes} [Mon Jun 20 18:52:52 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/os-volume_attachments/ed9e77b4-e4cd-43a8-8806-379e34217797 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:52:52.190463 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-83662520-6f8b-4131-990c-e63b4ae75581 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:52.190970 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-83662520-6f8b-4131-990c-e63b4ae75581 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:52.197054 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-83662520-6f8b-4131-990c-e63b4ae75581 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:52.197501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-83662520-6f8b-4131-990c-e63b4ae75581 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:52.198242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-83662520-6f8b-4131-990c-e63b4ae75581 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:52.198670 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-83662520-6f8b-4131-990c-e63b4ae75581 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:52.275426 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-83662520-6f8b-4131-990c-e63b4ae75581 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lazy-loading 'services' on Instance uuid aa52c387-5b77-4644-85c8-691b22dfeb78 {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:52:52.344672 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-83662520-6f8b-4131-990c-e63b4ae75581 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "DELETE /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/os-volume_attachments/ed9e77b4-e4cd-43a8-8806-379e34217797" status: 202 len: 0 microversion: 2.20 time: 0.157749 Jun 20 18:52:52.345187 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 376/737] 10.222.0.43 () {60 vars in 1456 bytes} [Mon Jun 20 18:52:52 2022] DELETE /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/os-volume_attachments/ed9e77b4-e4cd-43a8-8806-379e34217797 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:52:52.354468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8b51d49e-5864-4d5c-b380-0ea94747735b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:52.355424 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8b51d49e-5864-4d5c-b380-0ea94747735b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:52.361431 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8b51d49e-5864-4d5c-b380-0ea94747735b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:52.361890 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8b51d49e-5864-4d5c-b380-0ea94747735b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:52.362651 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8b51d49e-5864-4d5c-b380-0ea94747735b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:52.363276 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8b51d49e-5864-4d5c-b380-0ea94747735b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:52.392453 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8b51d49e-5864-4d5c-b380-0ea94747735b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042765 Jun 20 18:52:52.393008 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 362/738] 10.222.0.43 () {60 vars in 1342 bytes} [Mon Jun 20 18:52:52 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:52:52.923866 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3158a55d-375b-49a7-8216-281ce68526d8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:52.924574 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-3158a55d-375b-49a7-8216-281ce68526d8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:52.988622 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-3158a55d-375b-49a7-8216-281ce68526d8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:52.996062 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-3158a55d-375b-49a7-8216-281ce68526d8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1241 microversion: 2.1 time: 0.077080 Jun 20 18:52:53.003550 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 377/739] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:52 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:53.006231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f922cd58-4566-4149-9b6e-3ba977c74903 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:52:53.014180 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f922cd58-4566-4149-9b6e-3ba977c74903 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:53.025120 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f922cd58-4566-4149-9b6e-3ba977c74903 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:53.026075 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f922cd58-4566-4149-9b6e-3ba977c74903 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:53.026861 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f922cd58-4566-4149-9b6e-3ba977c74903 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:53.027344 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f922cd58-4566-4149-9b6e-3ba977c74903 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:53.052289 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-f922cd58-4566-4149-9b6e-3ba977c74903 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lazy-loading 'flavor' on Instance uuid f7fdf69c-2b2a-4801-82ca-54805176159b {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:52:53.164129 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:53.186154 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f922cd58-4566-4149-9b6e-3ba977c74903 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "POST /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/action" status: 200 len: 32 microversion: 2.1 time: 0.203803 Jun 20 18:52:53.186832 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 363/740] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jun 20 18:52:52 2022] POST /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/action => generated 32 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 18:52:53.196047 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e8c80ef6-2348-49ee-90e6-1e4d7da9ba7a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:53.196677 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e8c80ef6-2348-49ee-90e6-1e4d7da9ba7a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:53.203596 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e8c80ef6-2348-49ee-90e6-1e4d7da9ba7a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:53.204124 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e8c80ef6-2348-49ee-90e6-1e4d7da9ba7a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:53.204916 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e8c80ef6-2348-49ee-90e6-1e4d7da9ba7a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:53.205449 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e8c80ef6-2348-49ee-90e6-1e4d7da9ba7a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:53.405954 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4915c30d-7c51-4638-b44c-6ba911cb7440 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:53.407151 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-4915c30d-7c51-4638-b44c-6ba911cb7440 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:53.413769 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4915c30d-7c51-4638-b44c-6ba911cb7440 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:53.414212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4915c30d-7c51-4638-b44c-6ba911cb7440 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:53.415557 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4915c30d-7c51-4638-b44c-6ba911cb7440 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:53.415988 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4915c30d-7c51-4638-b44c-6ba911cb7440 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:53.419916 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e8c80ef6-2348-49ee-90e6-1e4d7da9ba7a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:53.428771 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e8c80ef6-2348-49ee-90e6-1e4d7da9ba7a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.236428 Jun 20 18:52:53.430958 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 378/741] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:53 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:53.457838 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4915c30d-7c51-4638-b44c-6ba911cb7440 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057488 Jun 20 18:52:53.458402 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 364/742] 10.222.0.43 () {60 vars in 1342 bytes} [Mon Jun 20 18:52:53 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 18:52:54.013645 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5c4ec8e2-d2e9-4dea-ab2f-7bf007c20ae1 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:54.014252 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5c4ec8e2-d2e9-4dea-ab2f-7bf007c20ae1 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:54.065748 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5c4ec8e2-d2e9-4dea-ab2f-7bf007c20ae1 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:54.072806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5c4ec8e2-d2e9-4dea-ab2f-7bf007c20ae1 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1241 microversion: 2.1 time: 0.062962 Jun 20 18:52:54.073361 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 379/743] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:54 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1241 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:54.448230 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-03e0f6c6-56a7-4d42-a990-f30cc2c13ef2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:54.448787 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-03e0f6c6-56a7-4d42-a990-f30cc2c13ef2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:54.455603 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-03e0f6c6-56a7-4d42-a990-f30cc2c13ef2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:54.456050 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-03e0f6c6-56a7-4d42-a990-f30cc2c13ef2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:54.456829 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-03e0f6c6-56a7-4d42-a990-f30cc2c13ef2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:54.457264 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-03e0f6c6-56a7-4d42-a990-f30cc2c13ef2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:54.469905 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-db538baf-da72-48b6-a7d7-5024d0fd26f7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:54.470903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-db538baf-da72-48b6-a7d7-5024d0fd26f7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:54.479523 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-db538baf-da72-48b6-a7d7-5024d0fd26f7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:54.479925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-db538baf-da72-48b6-a7d7-5024d0fd26f7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:54.480694 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-db538baf-da72-48b6-a7d7-5024d0fd26f7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:54.481127 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-db538baf-da72-48b6-a7d7-5024d0fd26f7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:54.507634 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:54.513063 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-db538baf-da72-48b6-a7d7-5024d0fd26f7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047310 Jun 20 18:52:54.513752 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 380/744] 10.222.0.43 () {60 vars in 1342 bytes} [Mon Jun 20 18:52:54 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:54.572497 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-66f28570-dc3f-42a5-9591-c645d8ab6f52 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:54.572990 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-66f28570-dc3f-42a5-9591-c645d8ab6f52 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:54.580287 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-66f28570-dc3f-42a5-9591-c645d8ab6f52 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:54.580731 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-66f28570-dc3f-42a5-9591-c645d8ab6f52 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:54.581487 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-66f28570-dc3f-42a5-9591-c645d8ab6f52 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:54.581918 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-66f28570-dc3f-42a5-9591-c645d8ab6f52 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:54.598040 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-03e0f6c6-56a7-4d42-a990-f30cc2c13ef2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:54.606115 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-03e0f6c6-56a7-4d42-a990-f30cc2c13ef2 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.162606 Jun 20 18:52:54.606676 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 365/745] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:54 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:54.606972 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-66f28570-dc3f-42a5-9591-c645d8ab6f52 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Going to try to terminate instance {{(pid=124189) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:52:54.680763 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-66f28570-dc3f-42a5-9591-c645d8ab6f52 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "DELETE /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 204 len: 0 microversion: 2.20 time: 0.111608 Jun 20 18:52:54.681549 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 381/746] 10.222.0.43 () {60 vars in 1279 bytes} [Mon Jun 20 18:52:54 2022] DELETE /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 20 18:52:54.689700 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-91b7ac70-41be-4741-ba9c-793db2d24b16 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:54.690302 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-91b7ac70-41be-4741-ba9c-793db2d24b16 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:54.696811 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91b7ac70-41be-4741-ba9c-793db2d24b16 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:54.697280 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91b7ac70-41be-4741-ba9c-793db2d24b16 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:54.698032 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91b7ac70-41be-4741-ba9c-793db2d24b16 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:54.698511 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91b7ac70-41be-4741-ba9c-793db2d24b16 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:54.828900 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-91b7ac70-41be-4741-ba9c-793db2d24b16 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:54.837337 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-91b7ac70-41be-4741-ba9c-793db2d24b16 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:54.838856 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-91b7ac70-41be-4741-ba9c-793db2d24b16 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:54.840025 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-91b7ac70-41be-4741-ba9c-793db2d24b16 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.154172 Jun 20 18:52:54.840573 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 366/747] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:52:54 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:52:55.090693 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fbb6ff5c-cdf8-48aa-9687-c6efa7b611f3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:55.091416 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fbb6ff5c-cdf8-48aa-9687-c6efa7b611f3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:55.097841 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fbb6ff5c-cdf8-48aa-9687-c6efa7b611f3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:55.098281 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fbb6ff5c-cdf8-48aa-9687-c6efa7b611f3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:55.099059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fbb6ff5c-cdf8-48aa-9687-c6efa7b611f3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:55.099489 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fbb6ff5c-cdf8-48aa-9687-c6efa7b611f3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:55.162442 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fbb6ff5c-cdf8-48aa-9687-c6efa7b611f3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:55.170596 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fbb6ff5c-cdf8-48aa-9687-c6efa7b611f3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1245 microversion: 2.1 time: 0.084658 Jun 20 18:52:55.171180 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 382/748] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:55 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:55.623494 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6edd2881-929b-42dc-9ffb-d6a9d1417f38 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:55.624101 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6edd2881-929b-42dc-9ffb-d6a9d1417f38 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:55.630641 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6edd2881-929b-42dc-9ffb-d6a9d1417f38 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:55.631129 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6edd2881-929b-42dc-9ffb-d6a9d1417f38 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:55.631888 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6edd2881-929b-42dc-9ffb-d6a9d1417f38 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:55.632323 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6edd2881-929b-42dc-9ffb-d6a9d1417f38 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:55.761099 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6edd2881-929b-42dc-9ffb-d6a9d1417f38 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:55.768888 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6edd2881-929b-42dc-9ffb-d6a9d1417f38 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.149310 Jun 20 18:52:55.769444 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 367/749] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:55 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:55.857956 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a6462f6e-5d50-4c87-b29c-62c4f5e75a00 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:55.858550 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a6462f6e-5d50-4c87-b29c-62c4f5e75a00 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:55.864492 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a6462f6e-5d50-4c87-b29c-62c4f5e75a00 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:55.864928 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a6462f6e-5d50-4c87-b29c-62c4f5e75a00 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:55.865669 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a6462f6e-5d50-4c87-b29c-62c4f5e75a00 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:55.866092 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a6462f6e-5d50-4c87-b29c-62c4f5e75a00 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:55.991766 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a6462f6e-5d50-4c87-b29c-62c4f5e75a00 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:56.000147 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a6462f6e-5d50-4c87-b29c-62c4f5e75a00 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:56.001627 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a6462f6e-5d50-4c87-b29c-62c4f5e75a00 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:56.002760 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a6462f6e-5d50-4c87-b29c-62c4f5e75a00 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.148664 Jun 20 18:52:56.003347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 383/750] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:52:55 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:52:56.187009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-186c19b1-5e17-46c0-9da8-f4d405d009df tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:56.187540 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-186c19b1-5e17-46c0-9da8-f4d405d009df tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:56.194213 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-186c19b1-5e17-46c0-9da8-f4d405d009df tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:56.194667 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-186c19b1-5e17-46c0-9da8-f4d405d009df tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:56.195488 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-186c19b1-5e17-46c0-9da8-f4d405d009df tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:56.196498 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-186c19b1-5e17-46c0-9da8-f4d405d009df tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:56.259365 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-186c19b1-5e17-46c0-9da8-f4d405d009df tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:56.266691 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-186c19b1-5e17-46c0-9da8-f4d405d009df tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1245 microversion: 2.1 time: 0.083639 Jun 20 18:52:56.267278 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 368/751] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:56 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:56.785939 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-32bc4d1b-ad9e-4a1e-b51d-9f56b28739cc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:56.786570 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-32bc4d1b-ad9e-4a1e-b51d-9f56b28739cc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:56.793919 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-32bc4d1b-ad9e-4a1e-b51d-9f56b28739cc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:56.794415 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-32bc4d1b-ad9e-4a1e-b51d-9f56b28739cc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:56.795190 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-32bc4d1b-ad9e-4a1e-b51d-9f56b28739cc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:56.795625 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-32bc4d1b-ad9e-4a1e-b51d-9f56b28739cc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:56.924182 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-32bc4d1b-ad9e-4a1e-b51d-9f56b28739cc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:56.932147 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-32bc4d1b-ad9e-4a1e-b51d-9f56b28739cc tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.150129 Jun 20 18:52:56.932716 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 384/752] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:56 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:57.021501 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0ea3367f-3f1b-4069-ac3b-c1db9f730f1a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:57.022262 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0ea3367f-3f1b-4069-ac3b-c1db9f730f1a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:57.030044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0ea3367f-3f1b-4069-ac3b-c1db9f730f1a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:57.030490 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0ea3367f-3f1b-4069-ac3b-c1db9f730f1a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:57.031274 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0ea3367f-3f1b-4069-ac3b-c1db9f730f1a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:57.031710 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0ea3367f-3f1b-4069-ac3b-c1db9f730f1a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:57.175818 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0ea3367f-3f1b-4069-ac3b-c1db9f730f1a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:57.183908 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0ea3367f-3f1b-4069-ac3b-c1db9f730f1a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:57.185400 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0ea3367f-3f1b-4069-ac3b-c1db9f730f1a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:57.186551 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0ea3367f-3f1b-4069-ac3b-c1db9f730f1a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1724 microversion: 2.20 time: 0.169063 Jun 20 18:52:57.187350 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 369/753] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:52:57 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:52:57.283284 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9de3dd89-3a31-4a78-84de-410e0868f9cf tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:57.283815 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9de3dd89-3a31-4a78-84de-410e0868f9cf tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:57.290223 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9de3dd89-3a31-4a78-84de-410e0868f9cf tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:57.290666 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9de3dd89-3a31-4a78-84de-410e0868f9cf tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:57.291458 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9de3dd89-3a31-4a78-84de-410e0868f9cf tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:57.291885 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9de3dd89-3a31-4a78-84de-410e0868f9cf tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:57.393135 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9de3dd89-3a31-4a78-84de-410e0868f9cf tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:57.400539 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9de3dd89-3a31-4a78-84de-410e0868f9cf tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1299 microversion: 2.1 time: 0.121104 Jun 20 18:52:57.401311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 385/754] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:57 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:57.950371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-cd57ec3c-870d-4960-bb91-a6c297b5c9d4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:57.950936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-cd57ec3c-870d-4960-bb91-a6c297b5c9d4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:57.957372 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cd57ec3c-870d-4960-bb91-a6c297b5c9d4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:57.957813 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cd57ec3c-870d-4960-bb91-a6c297b5c9d4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:57.958582 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cd57ec3c-870d-4960-bb91-a6c297b5c9d4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:57.959053 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cd57ec3c-870d-4960-bb91-a6c297b5c9d4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:58.107851 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cd57ec3c-870d-4960-bb91-a6c297b5c9d4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:58.118022 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-cd57ec3c-870d-4960-bb91-a6c297b5c9d4 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.170341 Jun 20 18:52:58.118894 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 370/755] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:57 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:58.205733 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f0cb9281-0849-4f5b-8ac7-9b6f02437b08 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:58.206268 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f0cb9281-0849-4f5b-8ac7-9b6f02437b08 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:58.213249 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f0cb9281-0849-4f5b-8ac7-9b6f02437b08 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:58.213700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f0cb9281-0849-4f5b-8ac7-9b6f02437b08 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:58.214497 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f0cb9281-0849-4f5b-8ac7-9b6f02437b08 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:58.215644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f0cb9281-0849-4f5b-8ac7-9b6f02437b08 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:58.333866 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f0cb9281-0849-4f5b-8ac7-9b6f02437b08 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:58.342503 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f0cb9281-0849-4f5b-8ac7-9b6f02437b08 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:58.344028 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f0cb9281-0849-4f5b-8ac7-9b6f02437b08 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:58.345171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f0cb9281-0849-4f5b-8ac7-9b6f02437b08 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1657 microversion: 2.20 time: 0.143490 Jun 20 18:52:58.346033 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 386/756] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:52:58 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1657 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:52:58.418325 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1d67a7cb-fbb3-4692-95ed-078d08460a26 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:58.418969 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1d67a7cb-fbb3-4692-95ed-078d08460a26 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:58.425215 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1d67a7cb-fbb3-4692-95ed-078d08460a26 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:58.425612 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1d67a7cb-fbb3-4692-95ed-078d08460a26 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:58.426382 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1d67a7cb-fbb3-4692-95ed-078d08460a26 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:58.426823 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1d67a7cb-fbb3-4692-95ed-078d08460a26 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:58.490255 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-1d67a7cb-fbb3-4692-95ed-078d08460a26 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:58.498020 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1d67a7cb-fbb3-4692-95ed-078d08460a26 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1299 microversion: 2.1 time: 0.084385 Jun 20 18:52:58.507526 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 371/757] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:58 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:58.690587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-1678a799-3445-4f04-8b1f-64125b4afb19 req-4fd59187-0edd-48cb-90b2-e49b00a0466a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa52c387-5b77-4644-85c8-691b22dfeb78", "name": "network-vif-deleted", "tag": "920abf72-084f-4d4e-be79-106c82668c67"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:52:58.703637 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-1678a799-3445-4f04-8b1f-64125b4afb19 req-4fd59187-0edd-48cb-90b2-e49b00a0466a service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:58.704167 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-1678a799-3445-4f04-8b1f-64125b4afb19 req-4fd59187-0edd-48cb-90b2-e49b00a0466a service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:58.719544 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-1678a799-3445-4f04-8b1f-64125b4afb19 req-4fd59187-0edd-48cb-90b2-e49b00a0466a service nova] Creating event network-vif-deleted:920abf72-084f-4d4e-be79-106c82668c67 for instance aa52c387-5b77-4644-85c8-691b22dfeb78 on hv-cinder-83697 Jun 20 18:52:58.730834 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-1678a799-3445-4f04-8b1f-64125b4afb19 req-4fd59187-0edd-48cb-90b2-e49b00a0466a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043618 Jun 20 18:52:58.731414 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 387/758] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:52:59.136475 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f7162eb5-8016-4536-a561-3a08c9a16ec7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:59.137692 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f7162eb5-8016-4536-a561-3a08c9a16ec7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:59.144503 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f7162eb5-8016-4536-a561-3a08c9a16ec7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:59.145059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f7162eb5-8016-4536-a561-3a08c9a16ec7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:59.145888 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f7162eb5-8016-4536-a561-3a08c9a16ec7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:59.146387 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f7162eb5-8016-4536-a561-3a08c9a16ec7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:59.313458 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f7162eb5-8016-4536-a561-3a08c9a16ec7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:59.323411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f7162eb5-8016-4536-a561-3a08c9a16ec7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.191311 Jun 20 18:52:59.325074 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 372/759] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:59 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:52:59.363767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ce384946-7e4c-49e4-88bd-1a5910ffa392 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:59.364443 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ce384946-7e4c-49e4-88bd-1a5910ffa392 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:59.371800 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ce384946-7e4c-49e4-88bd-1a5910ffa392 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:59.372255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ce384946-7e4c-49e4-88bd-1a5910ffa392 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:59.373066 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ce384946-7e4c-49e4-88bd-1a5910ffa392 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:59.373498 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ce384946-7e4c-49e4-88bd-1a5910ffa392 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:59.443702 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ce384946-7e4c-49e4-88bd-1a5910ffa392 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:59.444496 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ce384946-7e4c-49e4-88bd-1a5910ffa392 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:59.445017 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-ce384946-7e4c-49e4-88bd-1a5910ffa392 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lazy-loading 'fault' on Instance uuid aa52c387-5b77-4644-85c8-691b22dfeb78 {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:52:59.521669 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9005e8f8-f463-4427-960a-6f296d5e5264 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:52:59.522472 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9005e8f8-f463-4427-960a-6f296d5e5264 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:52:59.538109 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9005e8f8-f463-4427-960a-6f296d5e5264 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:59.539472 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9005e8f8-f463-4427-960a-6f296d5e5264 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:59.540592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9005e8f8-f463-4427-960a-6f296d5e5264 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:52:59.541487 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9005e8f8-f463-4427-960a-6f296d5e5264 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:52:59.545500 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ce384946-7e4c-49e4-88bd-1a5910ffa392 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:59.555698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ce384946-7e4c-49e4-88bd-1a5910ffa392 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:59.569405 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ce384946-7e4c-49e4-88bd-1a5910ffa392 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:59.571601 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ce384946-7e4c-49e4-88bd-1a5910ffa392 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 200 len: 1372 microversion: 2.20 time: 0.211973 Jun 20 18:52:59.572174 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 388/760] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:52:59 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:52:59.718186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9005e8f8-f463-4427-960a-6f296d5e5264 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:52:59.725839 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9005e8f8-f463-4427-960a-6f296d5e5264 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1367 microversion: 2.1 time: 0.214557 Jun 20 18:52:59.726412 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 373/761] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:52:59 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:00.342019 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-57eb0fe0-67e6-4cf9-9e0b-11d8a484a21b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:00.342617 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-57eb0fe0-67e6-4cf9-9e0b-11d8a484a21b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:00.344540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:00.349935 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-57eb0fe0-67e6-4cf9-9e0b-11d8a484a21b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:00.350374 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-57eb0fe0-67e6-4cf9-9e0b-11d8a484a21b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:00.351151 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-57eb0fe0-67e6-4cf9-9e0b-11d8a484a21b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:00.351584 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-57eb0fe0-67e6-4cf9-9e0b-11d8a484a21b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:00.476135 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-57eb0fe0-67e6-4cf9-9e0b-11d8a484a21b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:00.484527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-57eb0fe0-67e6-4cf9-9e0b-11d8a484a21b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.146354 Jun 20 18:53:00.485088 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 389/762] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:00 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:00.590270 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-32e506c1-b7c6-40fd-a575-11ba05bf8ace tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:00.590876 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-32e506c1-b7c6-40fd-a575-11ba05bf8ace tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:00.597421 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-32e506c1-b7c6-40fd-a575-11ba05bf8ace tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:00.597813 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-32e506c1-b7c6-40fd-a575-11ba05bf8ace tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:00.598576 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-32e506c1-b7c6-40fd-a575-11ba05bf8ace tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:00.599048 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-32e506c1-b7c6-40fd-a575-11ba05bf8ace tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:00.612943 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-32e506c1-b7c6-40fd-a575-11ba05bf8ace tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] HTTP exception thrown: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-32e506c1-b7c6-40fd-a575-11ba05bf8ace tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Request method failure captured: Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 HTTP/1.1 Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMB0jVacf4SMGHCrPlaiukJzg18XCdGsZ5l5-w2UHN4b4FxdP_mw-vNB2f8yzj8VNmocAK62qA_Af9FQtR_DvaSkHjgDmqI9y3AiuDYK-bDZRSC2T5bWbaaAxi5pCIIL_cYwH-H3ImotSvJ45IxeA48zk0Q-HFZ9g_yfU23_dgExA7g Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: b4944c36091d4f5f84e06386ee5a1589 Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:53:00.614561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:53:00.616158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b4944c36091d4f5f84e06386ee5a1589", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b4944c36091d4f5f84e06386ee5a1589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b4944c36091d4f5f84e06386ee5a1589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b4944c36091d4f5f84e06386ee5a1589"}]}] Jun 20 18:53:00.616158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:53:00.616158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: b4944c36091d4f5f84e06386ee5a1589 Jun 20 18:53:00.616158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:53:00.616158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-AttachVolumeShelveTestJSON-356597947-project Jun 20 18:53:00.616158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:53:00.616158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:53:00.616158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 60a36e18710443359ba2a56ad2810043 Jun 20 18:53:00.616158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-AttachVolumeShelveTestJSON-356597947-project Jun 20 18:53:00.616158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:53:00.616158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:53:00.616158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': 'aa52c387-5b77-4644-85c8-691b22dfeb78'} Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:53:00.617044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:53:00.618438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:53:00.619790 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-32e506c1-b7c6-40fd-a575-11ba05bf8ace tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Returning 404 to user: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:53:00.619790 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-32e506c1-b7c6-40fd-a575-11ba05bf8ace tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 404 len: 111 microversion: 2.20 time: 0.030119 Jun 20 18:53:00.619790 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 374/763] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:53:00 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 18:53:00.624598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-67a2e167-2cdd-4f27-aba2-38bff8d52e32 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '.version_select at 0x7f7e44798af0>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:00.640912 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-67a2e167-2cdd-4f27-aba2-38bff8d52e32 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475521525" status: 204 len: 0 microversion: 2.20 time: 0.020084 Jun 20 18:53:00.641471 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 390/764] 10.222.0.43 () {60 vars in 1261 bytes} [Mon Jun 20 18:53:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475521525 => generated 0 bytes in 21 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 18:53:00.744258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8924b8bd-9b98-413c-89bf-3779ddacbb3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:00.744880 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8924b8bd-9b98-413c-89bf-3779ddacbb3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:00.749798 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-c0ace589-4c78-4cd1-b8f5-af0b6dcb4e82 req-5fee0b1c-1ea7-4e8d-ab1f-11e2256f1e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d279054-6318-480a-a1d1-2c4a46085141", "tag": "061cd6f0-1710-4a3f-b086-37006d8f926a"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:00.751953 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8924b8bd-9b98-413c-89bf-3779ddacbb3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:00.753049 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8924b8bd-9b98-413c-89bf-3779ddacbb3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:00.753772 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8924b8bd-9b98-413c-89bf-3779ddacbb3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:00.754669 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8924b8bd-9b98-413c-89bf-3779ddacbb3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:00.759403 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-c0ace589-4c78-4cd1-b8f5-af0b6dcb4e82 req-5fee0b1c-1ea7-4e8d-ab1f-11e2256f1e39 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:00.760066 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-c0ace589-4c78-4cd1-b8f5-af0b6dcb4e82 req-5fee0b1c-1ea7-4e8d-ab1f-11e2256f1e39 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:00.772831 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-c0ace589-4c78-4cd1-b8f5-af0b6dcb4e82 req-5fee0b1c-1ea7-4e8d-ab1f-11e2256f1e39 service nova] Creating event network-changed:061cd6f0-1710-4a3f-b086-37006d8f926a for instance 3d279054-6318-480a-a1d1-2c4a46085141 on hv-cinder-83697 Jun 20 18:53:00.780355 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-c0ace589-4c78-4cd1-b8f5-af0b6dcb4e82 req-5fee0b1c-1ea7-4e8d-ab1f-11e2256f1e39 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036294 Jun 20 18:53:00.781231 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 391/765] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:53:00.821556 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=6 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:00.914709 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8924b8bd-9b98-413c-89bf-3779ddacbb3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:00.922222 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8924b8bd-9b98-413c-89bf-3779ddacbb3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1367 microversion: 2.1 time: 0.183148 Jun 20 18:53:00.922783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 375/766] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:00 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:01.297400 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-512e3186-022c-41e9-b3ba-9b32d7adca30 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Action: 'create', calling method: .version_select at 0x7f7e4475e5e0>, body: {"keypair": {"name": "tempest-keypair-786175635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnCrFawX/1q+x9zZoQLWloh+J+HDyTVf7v6iIGk/xZtXItkc+A4pkrpzwEKW0t2ctEVkYdWtW+1QkaUJY2h2o+bTMJW+iwo72VrrxeYc/dC+M5LsIc0cF7B7qNcoceg2Q=="}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:01.310740 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-512e3186-022c-41e9-b3ba-9b32d7adca30 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Getting quotas for project b4944c36091d4f5f84e06386ee5a1589. Resources: {'key_pairs'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:53:01.314423 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-512e3186-022c-41e9-b3ba-9b32d7adca30 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Getting quotas for user 60a36e18710443359ba2a56ad2810043 and project b4944c36091d4f5f84e06386ee5a1589. Resources: {'key_pairs'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:53:01.335265 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-512e3186-022c-41e9-b3ba-9b32d7adca30 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.042019 Jun 20 18:53:01.335844 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 392/767] 10.222.0.43 () {62 vars in 1199 bytes} [Mon Jun 20 18:53:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 43 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 18:53:01.614302 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0d715a55-8ea8-40a4-89b6-4ec34e122573 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:01.614931 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0d715a55-8ea8-40a4-89b6-4ec34e122573 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:01.621534 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0d715a55-8ea8-40a4-89b6-4ec34e122573 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:01.621979 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0d715a55-8ea8-40a4-89b6-4ec34e122573 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:01.622740 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0d715a55-8ea8-40a4-89b6-4ec34e122573 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:01.623202 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0d715a55-8ea8-40a4-89b6-4ec34e122573 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:01.796082 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0d715a55-8ea8-40a4-89b6-4ec34e122573 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:01.804209 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0d715a55-8ea8-40a4-89b6-4ec34e122573 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.306521 Jun 20 18:53:01.805496 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 376/768] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:01 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:01.940097 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fba54309-c182-46fe-9ae1-1c7b09964a9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:01.940917 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fba54309-c182-46fe-9ae1-1c7b09964a9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:01.947119 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fba54309-c182-46fe-9ae1-1c7b09964a9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:01.947567 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fba54309-c182-46fe-9ae1-1c7b09964a9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:01.948329 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fba54309-c182-46fe-9ae1-1c7b09964a9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:01.948763 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fba54309-c182-46fe-9ae1-1c7b09964a9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:02.154840 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fba54309-c182-46fe-9ae1-1c7b09964a9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:02.162274 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fba54309-c182-46fe-9ae1-1c7b09964a9d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1367 microversion: 2.1 time: 0.226600 Jun 20 18:53:02.163069 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 393/769] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:01 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:02.822234 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-3e2f45e7-025d-42b9-b545-d427e4c50755 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:02.822985 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-3e2f45e7-025d-42b9-b545-d427e4c50755 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:02.830136 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3e2f45e7-025d-42b9-b545-d427e4c50755 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:02.830825 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3e2f45e7-025d-42b9-b545-d427e4c50755 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:02.832355 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3e2f45e7-025d-42b9-b545-d427e4c50755 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:02.832948 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3e2f45e7-025d-42b9-b545-d427e4c50755 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:02.891876 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1420670788", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cac90707-8479-4653-a9fa-f25caced7385"}], "security_groups": [{"name": "tempest-securitygroup--1142117285"}], "key_name": "tempest-keypair-786175635", "user_data": "}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:03.013056 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-3e2f45e7-025d-42b9-b545-d427e4c50755 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:03.023817 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-3e2f45e7-025d-42b9-b545-d427e4c50755 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.206032 Jun 20 18:53:03.024528 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 377/770] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:02 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:03.043640 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.network.neutron [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] validate_networks() for [('cac90707-8479-4653-a9fa-f25caced7385', None, None, None, None, None)] {{(pid=124189) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:53:03.180903 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a525a962-0af7-47cb-9cda-f284f80f0efa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:03.181611 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a525a962-0af7-47cb-9cda-f284f80f0efa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:03.187563 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a525a962-0af7-47cb-9cda-f284f80f0efa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:03.188007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a525a962-0af7-47cb-9cda-f284f80f0efa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:03.188765 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a525a962-0af7-47cb-9cda-f284f80f0efa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:03.189199 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a525a962-0af7-47cb-9cda-f284f80f0efa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:03.309100 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:03.321357 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a525a962-0af7-47cb-9cda-f284f80f0efa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:03.329305 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a525a962-0af7-47cb-9cda-f284f80f0efa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1367 microversion: 2.1 time: 0.152931 Jun 20 18:53:03.329989 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 378/771] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:03 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:03.337560 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a0817818-a2bc-40df-8bfb-26ca41b8c51e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:03.337560 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a0817818-a2bc-40df-8bfb-26ca41b8c51e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:03.342387 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a0817818-a2bc-40df-8bfb-26ca41b8c51e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:03.342831 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a0817818-a2bc-40df-8bfb-26ca41b8c51e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:03.343623 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a0817818-a2bc-40df-8bfb-26ca41b8c51e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:03.344058 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a0817818-a2bc-40df-8bfb-26ca41b8c51e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:03.366101 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-a0817818-a2bc-40df-8bfb-26ca41b8c51e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lazy-loading 'flavor' on Instance uuid 85165412-e44c-453d-aa22-d248bff1a459 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:53:03.393146 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:03.440237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a0817818-a2bc-40df-8bfb-26ca41b8c51e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "POST /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459/action" status: 202 len: 0 microversion: 2.1 time: 0.108890 Jun 20 18:53:03.441373 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 379/772] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jun 20 18:53:03 2022] POST /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:53:03.450161 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-66512909-e8ea-45c5-9940-2879177c5f39 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:03.451028 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-66512909-e8ea-45c5-9940-2879177c5f39 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:03.458185 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-66512909-e8ea-45c5-9940-2879177c5f39 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:03.458404 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-66512909-e8ea-45c5-9940-2879177c5f39 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:03.459348 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-66512909-e8ea-45c5-9940-2879177c5f39 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:03.460092 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-66512909-e8ea-45c5-9940-2879177c5f39 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:03.530168 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Flavor limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:53:03.530697 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Image limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:53:03.531262 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Flavor pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:53:03.532251 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Image pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:53:03.533013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:53:03.543217 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:03.544047 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:03.544965 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:03.545608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:03.567471 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Getting quotas for project b4944c36091d4f5f84e06386ee5a1589. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:53:03.572621 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Getting quotas for user 60a36e18710443359ba2a56ad2810043 and project b4944c36091d4f5f84e06386ee5a1589. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:53:03.584939 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Going to run 1 instances... {{(pid=124189) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:53:03.587790 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124189) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:53:03.603954 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-66512909-e8ea-45c5-9940-2879177c5f39 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:03.612050 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-66512909-e8ea-45c5-9940-2879177c5f39 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.166696 Jun 20 18:53:03.622566 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 380/773] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:03 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:53:03.634390 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8a987a45-cc1b-4a51-9219-4c5f516168ad tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.746968 Jun 20 18:53:03.635183 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 394/774] 10.222.0.43 () {62 vars in 1187 bytes} [Mon Jun 20 18:53:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 20 18:53:03.645349 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c1e733b2-101d-4efc-a9b1-e30be4418c50 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:03.645882 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c1e733b2-101d-4efc-a9b1-e30be4418c50 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:03.701595 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c1e733b2-101d-4efc-a9b1-e30be4418c50 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:03.709774 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c1e733b2-101d-4efc-a9b1-e30be4418c50 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:03.715011 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c1e733b2-101d-4efc-a9b1-e30be4418c50 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:03.715011 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c1e733b2-101d-4efc-a9b1-e30be4418c50 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1281 microversion: 2.20 time: 0.071888 Jun 20 18:53:03.715011 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 381/775] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:53:03 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:53:04.041936 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8c577bb7-5c19-4ca0-a450-37cbe6433ba0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:04.042539 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8c577bb7-5c19-4ca0-a450-37cbe6433ba0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:04.049835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8c577bb7-5c19-4ca0-a450-37cbe6433ba0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:04.050485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8c577bb7-5c19-4ca0-a450-37cbe6433ba0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:04.051079 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8c577bb7-5c19-4ca0-a450-37cbe6433ba0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:04.051528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8c577bb7-5c19-4ca0-a450-37cbe6433ba0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:04.182007 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8c577bb7-5c19-4ca0-a450-37cbe6433ba0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:04.190143 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8c577bb7-5c19-4ca0-a450-37cbe6433ba0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.152794 Jun 20 18:53:04.190710 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 395/776] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:04 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:04.347212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e7b16e3b-ac2b-4af5-8d08-580b7f6caecd tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:04.347983 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e7b16e3b-ac2b-4af5-8d08-580b7f6caecd tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:04.355105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e7b16e3b-ac2b-4af5-8d08-580b7f6caecd tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:04.355553 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e7b16e3b-ac2b-4af5-8d08-580b7f6caecd tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:04.356447 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e7b16e3b-ac2b-4af5-8d08-580b7f6caecd tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:04.356885 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e7b16e3b-ac2b-4af5-8d08-580b7f6caecd tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:04.483074 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e7b16e3b-ac2b-4af5-8d08-580b7f6caecd tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:04.490318 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e7b16e3b-ac2b-4af5-8d08-580b7f6caecd tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1367 microversion: 2.1 time: 0.147007 Jun 20 18:53:04.490872 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 382/777] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:04 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:04.630095 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-74a42150-b09a-47d4-af9c-b6e56d384228 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:04.630703 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-74a42150-b09a-47d4-af9c-b6e56d384228 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:04.637207 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-74a42150-b09a-47d4-af9c-b6e56d384228 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:04.637648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-74a42150-b09a-47d4-af9c-b6e56d384228 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:04.638409 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-74a42150-b09a-47d4-af9c-b6e56d384228 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:04.638837 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-74a42150-b09a-47d4-af9c-b6e56d384228 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:04.731262 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b253ae30-4b3c-45ad-a9cc-bb00f531fecc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:04.732092 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b253ae30-4b3c-45ad-a9cc-bb00f531fecc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:04.738322 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b253ae30-4b3c-45ad-a9cc-bb00f531fecc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:04.739172 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b253ae30-4b3c-45ad-a9cc-bb00f531fecc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:04.740092 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b253ae30-4b3c-45ad-a9cc-bb00f531fecc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:04.740677 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b253ae30-4b3c-45ad-a9cc-bb00f531fecc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:04.817172 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-74a42150-b09a-47d4-af9c-b6e56d384228 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:04.832312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-74a42150-b09a-47d4-af9c-b6e56d384228 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.204234 Jun 20 18:53:04.844827 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 396/778] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:04 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:04.845031 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b253ae30-4b3c-45ad-a9cc-bb00f531fecc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:04.850788 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b253ae30-4b3c-45ad-a9cc-bb00f531fecc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:04.852357 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b253ae30-4b3c-45ad-a9cc-bb00f531fecc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:04.853757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b253ae30-4b3c-45ad-a9cc-bb00f531fecc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1341 microversion: 2.20 time: 0.126445 Jun 20 18:53:04.854628 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 383/779] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:53:04 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1341 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:53:04.985623 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-3c948d0e-8a3d-4818-9133-482a3685564e req-8c67c974-0495-4663-a91a-7f0046ea9135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d279054-6318-480a-a1d1-2c4a46085141", "name": "network-vif-plugged", "status": "completed", "tag": "061cd6f0-1710-4a3f-b086-37006d8f926a"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:04.995237 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-3c948d0e-8a3d-4818-9133-482a3685564e req-8c67c974-0495-4663-a91a-7f0046ea9135 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:04.995237 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-3c948d0e-8a3d-4818-9133-482a3685564e req-8c67c974-0495-4663-a91a-7f0046ea9135 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:05.162098 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-3c948d0e-8a3d-4818-9133-482a3685564e req-8c67c974-0495-4663-a91a-7f0046ea9135 service nova] Creating event network-vif-plugged:061cd6f0-1710-4a3f-b086-37006d8f926a for instance 3d279054-6318-480a-a1d1-2c4a46085141 on hv-cinder-83697 Jun 20 18:53:05.167152 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-3c948d0e-8a3d-4818-9133-482a3685564e req-8c67c974-0495-4663-a91a-7f0046ea9135 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255195 Jun 20 18:53:05.167925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 397/780] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:53:05.208618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-aaad5c57-088a-4f9e-9254-6a245849f720 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:05.209225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-aaad5c57-088a-4f9e-9254-6a245849f720 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:05.215343 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-aaad5c57-088a-4f9e-9254-6a245849f720 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:05.215794 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-aaad5c57-088a-4f9e-9254-6a245849f720 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:05.216565 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-aaad5c57-088a-4f9e-9254-6a245849f720 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:05.217002 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-aaad5c57-088a-4f9e-9254-6a245849f720 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:05.350374 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-aaad5c57-088a-4f9e-9254-6a245849f720 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:05.359852 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-aaad5c57-088a-4f9e-9254-6a245849f720 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.154934 Jun 20 18:53:05.360429 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 384/781] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:05 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:05.508529 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9e5c3c88-4bd0-4c64-a0cf-0be3d86a20de tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:05.509454 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9e5c3c88-4bd0-4c64-a0cf-0be3d86a20de tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:05.516309 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9e5c3c88-4bd0-4c64-a0cf-0be3d86a20de tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:05.516825 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9e5c3c88-4bd0-4c64-a0cf-0be3d86a20de tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:05.517663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9e5c3c88-4bd0-4c64-a0cf-0be3d86a20de tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:05.518172 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9e5c3c88-4bd0-4c64-a0cf-0be3d86a20de tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:05.790174 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9e5c3c88-4bd0-4c64-a0cf-0be3d86a20de tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:05.797586 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9e5c3c88-4bd0-4c64-a0cf-0be3d86a20de tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1367 microversion: 2.1 time: 0.293942 Jun 20 18:53:05.798150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 398/782] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:05 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:05.853467 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8201ffc8-b99e-4586-8bd6-8f7302a9b9aa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:05.854167 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8201ffc8-b99e-4586-8bd6-8f7302a9b9aa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:05.860744 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8201ffc8-b99e-4586-8bd6-8f7302a9b9aa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:05.861224 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8201ffc8-b99e-4586-8bd6-8f7302a9b9aa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:05.862116 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8201ffc8-b99e-4586-8bd6-8f7302a9b9aa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:05.862646 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8201ffc8-b99e-4586-8bd6-8f7302a9b9aa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:05.872336 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9bf44bc2-6174-45f4-ac6f-fc8abfd5c848 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:05.872933 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9bf44bc2-6174-45f4-ac6f-fc8abfd5c848 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:05.879297 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9bf44bc2-6174-45f4-ac6f-fc8abfd5c848 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:05.880036 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9bf44bc2-6174-45f4-ac6f-fc8abfd5c848 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:05.881000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9bf44bc2-6174-45f4-ac6f-fc8abfd5c848 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:05.881437 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9bf44bc2-6174-45f4-ac6f-fc8abfd5c848 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:06.016216 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8201ffc8-b99e-4586-8bd6-8f7302a9b9aa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:06.025029 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8201ffc8-b99e-4586-8bd6-8f7302a9b9aa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.176242 Jun 20 18:53:06.025821 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 385/783] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:05 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:06.062031 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9bf44bc2-6174-45f4-ac6f-fc8abfd5c848 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:06.071693 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9bf44bc2-6174-45f4-ac6f-fc8abfd5c848 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:06.073224 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9bf44bc2-6174-45f4-ac6f-fc8abfd5c848 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:06.074483 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9bf44bc2-6174-45f4-ac6f-fc8abfd5c848 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1407 microversion: 2.20 time: 0.205889 Jun 20 18:53:06.075122 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 399/784] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:53:05 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:53:06.378008 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-04b7db3e-0f0a-450b-a0c1-f57345375911 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:06.378631 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-04b7db3e-0f0a-450b-a0c1-f57345375911 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:06.385619 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-04b7db3e-0f0a-450b-a0c1-f57345375911 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:06.386061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-04b7db3e-0f0a-450b-a0c1-f57345375911 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:06.386816 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-04b7db3e-0f0a-450b-a0c1-f57345375911 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:06.387272 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-04b7db3e-0f0a-450b-a0c1-f57345375911 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:06.519114 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-04b7db3e-0f0a-450b-a0c1-f57345375911 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:06.528033 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-04b7db3e-0f0a-450b-a0c1-f57345375911 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.153854 Jun 20 18:53:06.528633 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 386/785] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:06 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:06.818072 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fe7e3817-3c37-48ff-b896-50abd2eb70b3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:06.819250 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fe7e3817-3c37-48ff-b896-50abd2eb70b3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:06.827503 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fe7e3817-3c37-48ff-b896-50abd2eb70b3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:06.828075 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fe7e3817-3c37-48ff-b896-50abd2eb70b3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:06.828852 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fe7e3817-3c37-48ff-b896-50abd2eb70b3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:06.829284 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fe7e3817-3c37-48ff-b896-50abd2eb70b3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:06.833734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:06.877867 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-52dea170-b832-4dd8-be44-d009becf4782 req-2c5dc4ed-16a8-4d00-8d3d-7048d6fd26b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb97000-4705-4f02-bdd0-00047a203abf", "tag": "d20d672a-4e79-42b8-b764-55a554f24b8b"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:06.886716 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-52dea170-b832-4dd8-be44-d009becf4782 req-2c5dc4ed-16a8-4d00-8d3d-7048d6fd26b3 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:06.887179 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-52dea170-b832-4dd8-be44-d009becf4782 req-2c5dc4ed-16a8-4d00-8d3d-7048d6fd26b3 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:06.899462 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-52dea170-b832-4dd8-be44-d009becf4782 req-2c5dc4ed-16a8-4d00-8d3d-7048d6fd26b3 service nova] Creating event network-changed:d20d672a-4e79-42b8-b764-55a554f24b8b for instance dcb97000-4705-4f02-bdd0-00047a203abf on hv-cinder-83697 Jun 20 18:53:06.904653 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-52dea170-b832-4dd8-be44-d009becf4782 req-2c5dc4ed-16a8-4d00-8d3d-7048d6fd26b3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030603 Jun 20 18:53:06.905432 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 387/786] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:53:06.998240 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fe7e3817-3c37-48ff-b896-50abd2eb70b3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:07.005811 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fe7e3817-3c37-48ff-b896-50abd2eb70b3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1367 microversion: 2.1 time: 0.194615 Jun 20 18:53:07.006563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 400/787] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:06 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:07.043677 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c0ad25d2-c165-47bc-8d0b-14a81dad16a0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:07.044570 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c0ad25d2-c165-47bc-8d0b-14a81dad16a0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:07.051999 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c0ad25d2-c165-47bc-8d0b-14a81dad16a0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:07.052455 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c0ad25d2-c165-47bc-8d0b-14a81dad16a0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:07.053255 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c0ad25d2-c165-47bc-8d0b-14a81dad16a0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:07.053693 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c0ad25d2-c165-47bc-8d0b-14a81dad16a0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:07.092931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ceb2009d-eca7-4871-b53e-4968f54e295c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:07.093619 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ceb2009d-eca7-4871-b53e-4968f54e295c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:07.099661 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ceb2009d-eca7-4871-b53e-4968f54e295c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:07.100109 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ceb2009d-eca7-4871-b53e-4968f54e295c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:07.100879 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ceb2009d-eca7-4871-b53e-4968f54e295c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:07.101313 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ceb2009d-eca7-4871-b53e-4968f54e295c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:07.202434 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c0ad25d2-c165-47bc-8d0b-14a81dad16a0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:07.209841 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c0ad25d2-c165-47bc-8d0b-14a81dad16a0 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.171505 Jun 20 18:53:07.210389 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 388/788] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:07 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:07.323815 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ceb2009d-eca7-4871-b53e-4968f54e295c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:07.331942 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ceb2009d-eca7-4871-b53e-4968f54e295c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:07.333432 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ceb2009d-eca7-4871-b53e-4968f54e295c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:07.334532 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ceb2009d-eca7-4871-b53e-4968f54e295c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1407 microversion: 2.20 time: 0.245483 Jun 20 18:53:07.335112 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 401/789] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:53:07 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:53:07.545859 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a18bbd65-3308-42f0-b916-e780f7957b0c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:07.546459 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a18bbd65-3308-42f0-b916-e780f7957b0c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:07.552856 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a18bbd65-3308-42f0-b916-e780f7957b0c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:07.553303 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a18bbd65-3308-42f0-b916-e780f7957b0c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:07.554055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a18bbd65-3308-42f0-b916-e780f7957b0c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:07.554513 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a18bbd65-3308-42f0-b916-e780f7957b0c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:07.681471 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a18bbd65-3308-42f0-b916-e780f7957b0c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:07.689358 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a18bbd65-3308-42f0-b916-e780f7957b0c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.147369 Jun 20 18:53:07.689908 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 389/790] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:07 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:08.022190 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-2ecc7809-3915-4c20-9e07-09f957c54c33 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:08.023469 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-2ecc7809-3915-4c20-9e07-09f957c54c33 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:08.030447 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2ecc7809-3915-4c20-9e07-09f957c54c33 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:08.031095 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2ecc7809-3915-4c20-9e07-09f957c54c33 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:08.032015 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2ecc7809-3915-4c20-9e07-09f957c54c33 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:08.032818 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2ecc7809-3915-4c20-9e07-09f957c54c33 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:08.227288 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e9379b20-4e57-4922-a585-be4644d5d79e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:08.227871 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e9379b20-4e57-4922-a585-be4644d5d79e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:08.233937 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e9379b20-4e57-4922-a585-be4644d5d79e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:08.234383 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e9379b20-4e57-4922-a585-be4644d5d79e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:08.235208 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e9379b20-4e57-4922-a585-be4644d5d79e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:08.235646 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e9379b20-4e57-4922-a585-be4644d5d79e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:08.317746 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-2ecc7809-3915-4c20-9e07-09f957c54c33 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:08.325816 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-2ecc7809-3915-4c20-9e07-09f957c54c33 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1557 microversion: 2.1 time: 0.307418 Jun 20 18:53:08.326499 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 402/791] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:08 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1557 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:08.341837 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d0926edb-b626-4435-bca8-187fa2abc693 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:08.342326 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d0926edb-b626-4435-bca8-187fa2abc693 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:08.348459 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d0926edb-b626-4435-bca8-187fa2abc693 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:08.348911 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d0926edb-b626-4435-bca8-187fa2abc693 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:08.349675 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d0926edb-b626-4435-bca8-187fa2abc693 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:08.350111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d0926edb-b626-4435-bca8-187fa2abc693 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:08.375549 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e9379b20-4e57-4922-a585-be4644d5d79e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:08.383184 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e9379b20-4e57-4922-a585-be4644d5d79e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.160474 Jun 20 18:53:08.383745 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 390/792] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:08 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:53:08.388156 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d59924c7-bae7-4fa2-aa9b-1fe01c537180 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:08.389029 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d59924c7-bae7-4fa2-aa9b-1fe01c537180 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:08.394516 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d59924c7-bae7-4fa2-aa9b-1fe01c537180 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:08.394989 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d59924c7-bae7-4fa2-aa9b-1fe01c537180 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:08.395747 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d59924c7-bae7-4fa2-aa9b-1fe01c537180 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:08.396179 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d59924c7-bae7-4fa2-aa9b-1fe01c537180 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:08.517337 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d0926edb-b626-4435-bca8-187fa2abc693 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.179188 Jun 20 18:53:08.518039 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 403/793] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jun 20 18:53:08 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/os-interface => generated 285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:53:08.524853 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d59924c7-bae7-4fa2-aa9b-1fe01c537180 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:08.533986 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d59924c7-bae7-4fa2-aa9b-1fe01c537180 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:08.535739 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d59924c7-bae7-4fa2-aa9b-1fe01c537180 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:08.537120 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d59924c7-bae7-4fa2-aa9b-1fe01c537180 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1407 microversion: 2.20 time: 0.152324 Jun 20 18:53:08.537882 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 391/794] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:53:08 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:53:08.706847 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-47836d6b-5754-41fe-bae8-7d44c31e0625 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:08.707483 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-47836d6b-5754-41fe-bae8-7d44c31e0625 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:08.719133 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-47836d6b-5754-41fe-bae8-7d44c31e0625 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:08.719598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-47836d6b-5754-41fe-bae8-7d44c31e0625 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:08.720578 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-47836d6b-5754-41fe-bae8-7d44c31e0625 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:08.721107 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-47836d6b-5754-41fe-bae8-7d44c31e0625 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:08.901247 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-47836d6b-5754-41fe-bae8-7d44c31e0625 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:08.909570 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-47836d6b-5754-41fe-bae8-7d44c31e0625 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.206454 Jun 20 18:53:08.910146 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 404/795] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:08 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:09.400435 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f0e933e2-989c-42ca-819c-8421a8345b72 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:09.401054 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f0e933e2-989c-42ca-819c-8421a8345b72 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:09.405645 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:09.410648 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f0e933e2-989c-42ca-819c-8421a8345b72 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:09.411201 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f0e933e2-989c-42ca-819c-8421a8345b72 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:09.412672 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f0e933e2-989c-42ca-819c-8421a8345b72 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:09.413211 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f0e933e2-989c-42ca-819c-8421a8345b72 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:09.558057 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-bc4b6252-82d4-482c-a2ea-74843e000b34 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:09.558666 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-bc4b6252-82d4-482c-a2ea-74843e000b34 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:09.565248 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bc4b6252-82d4-482c-a2ea-74843e000b34 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:09.565699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bc4b6252-82d4-482c-a2ea-74843e000b34 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:09.566463 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bc4b6252-82d4-482c-a2ea-74843e000b34 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:09.566946 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bc4b6252-82d4-482c-a2ea-74843e000b34 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:09.637742 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f0e933e2-989c-42ca-819c-8421a8345b72 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:09.645588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f0e933e2-989c-42ca-819c-8421a8345b72 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.249301 Jun 20 18:53:09.646491 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 392/796] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:09 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:09.696086 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-bc4b6252-82d4-482c-a2ea-74843e000b34 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:09.704245 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-bc4b6252-82d4-482c-a2ea-74843e000b34 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:09.705783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-bc4b6252-82d4-482c-a2ea-74843e000b34 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:09.706926 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-bc4b6252-82d4-482c-a2ea-74843e000b34 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1407 microversion: 2.20 time: 0.153397 Jun 20 18:53:09.707472 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 405/797] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:53:09 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:53:09.847921 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-1b435f02-f487-4f00-85b2-08f22f9b96ad req-59c24747-262b-4944-a14a-2a8f3d0a77cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d279054-6318-480a-a1d1-2c4a46085141", "tag": "061cd6f0-1710-4a3f-b086-37006d8f926a"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:09.856713 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-1b435f02-f487-4f00-85b2-08f22f9b96ad req-59c24747-262b-4944-a14a-2a8f3d0a77cf service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:09.857152 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-1b435f02-f487-4f00-85b2-08f22f9b96ad req-59c24747-262b-4944-a14a-2a8f3d0a77cf service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:09.868165 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-1b435f02-f487-4f00-85b2-08f22f9b96ad req-59c24747-262b-4944-a14a-2a8f3d0a77cf service nova] Creating event network-changed:061cd6f0-1710-4a3f-b086-37006d8f926a for instance 3d279054-6318-480a-a1d1-2c4a46085141 on hv-cinder-83697 Jun 20 18:53:09.873070 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-1b435f02-f487-4f00-85b2-08f22f9b96ad req-59c24747-262b-4944-a14a-2a8f3d0a77cf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084239 Jun 20 18:53:09.873838 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 393/798] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:53:09.927807 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a3fb6b04-262b-4617-a1c4-2d66faf0f36a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:09.928410 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a3fb6b04-262b-4617-a1c4-2d66faf0f36a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:09.934411 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a3fb6b04-262b-4617-a1c4-2d66faf0f36a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:09.934853 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a3fb6b04-262b-4617-a1c4-2d66faf0f36a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:09.935626 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a3fb6b04-262b-4617-a1c4-2d66faf0f36a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:09.936049 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a3fb6b04-262b-4617-a1c4-2d66faf0f36a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:10.062160 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a3fb6b04-262b-4617-a1c4-2d66faf0f36a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:10.070697 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a3fb6b04-262b-4617-a1c4-2d66faf0f36a tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.146180 Jun 20 18:53:10.071471 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 406/799] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:09 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:10.663891 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-3a90a1a8-56bf-4d08-92ba-5fdefb2ed255 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:10.664596 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-3a90a1a8-56bf-4d08-92ba-5fdefb2ed255 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:10.670956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3a90a1a8-56bf-4d08-92ba-5fdefb2ed255 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:10.671408 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3a90a1a8-56bf-4d08-92ba-5fdefb2ed255 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:10.672177 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3a90a1a8-56bf-4d08-92ba-5fdefb2ed255 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:10.672612 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3a90a1a8-56bf-4d08-92ba-5fdefb2ed255 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:10.726467 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c2ecf784-91b3-4ecc-928c-925799bb9418 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:10.727156 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c2ecf784-91b3-4ecc-928c-925799bb9418 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:10.736780 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2ecf784-91b3-4ecc-928c-925799bb9418 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:10.737228 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2ecf784-91b3-4ecc-928c-925799bb9418 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:10.738637 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2ecf784-91b3-4ecc-928c-925799bb9418 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:10.739103 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c2ecf784-91b3-4ecc-928c-925799bb9418 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:10.866323 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-3a90a1a8-56bf-4d08-92ba-5fdefb2ed255 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:10.875924 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-3a90a1a8-56bf-4d08-92ba-5fdefb2ed255 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.217063 Jun 20 18:53:10.876506 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 394/800] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:10 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:10.899261 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c2ecf784-91b3-4ecc-928c-925799bb9418 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:10.907637 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c2ecf784-91b3-4ecc-928c-925799bb9418 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:10.909202 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c2ecf784-91b3-4ecc-928c-925799bb9418 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:10.910990 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c2ecf784-91b3-4ecc-928c-925799bb9418 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1407 microversion: 2.20 time: 0.189646 Jun 20 18:53:10.911818 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 407/801] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:53:10 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:53:11.088279 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-dbf6fbbe-bb90-4747-b18d-98d5f6e408c8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:11.089307 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-dbf6fbbe-bb90-4747-b18d-98d5f6e408c8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:11.098621 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dbf6fbbe-bb90-4747-b18d-98d5f6e408c8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:11.099041 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dbf6fbbe-bb90-4747-b18d-98d5f6e408c8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:11.099830 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dbf6fbbe-bb90-4747-b18d-98d5f6e408c8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:11.100270 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dbf6fbbe-bb90-4747-b18d-98d5f6e408c8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:11.231491 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-dbf6fbbe-bb90-4747-b18d-98d5f6e408c8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:11.239344 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-dbf6fbbe-bb90-4747-b18d-98d5f6e408c8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.155598 Jun 20 18:53:11.239899 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 395/802] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:11 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:11.892907 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-01a0c3c1-c055-4768-89e3-104d61953d37 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:11.893419 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-01a0c3c1-c055-4768-89e3-104d61953d37 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:11.899820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-01a0c3c1-c055-4768-89e3-104d61953d37 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:11.900259 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-01a0c3c1-c055-4768-89e3-104d61953d37 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:11.901007 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-01a0c3c1-c055-4768-89e3-104d61953d37 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:11.901431 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-01a0c3c1-c055-4768-89e3-104d61953d37 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:11.928847 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-47c00cd2-db5b-402c-94de-a8ea6e1c7161 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:11.929946 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-47c00cd2-db5b-402c-94de-a8ea6e1c7161 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:11.936483 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-47c00cd2-db5b-402c-94de-a8ea6e1c7161 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:11.936927 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-47c00cd2-db5b-402c-94de-a8ea6e1c7161 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:11.937695 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-47c00cd2-db5b-402c-94de-a8ea6e1c7161 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:11.938125 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-47c00cd2-db5b-402c-94de-a8ea6e1c7161 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:12.029868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-01a0c3c1-c055-4768-89e3-104d61953d37 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:12.037287 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-01a0c3c1-c055-4768-89e3-104d61953d37 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.148320 Jun 20 18:53:12.037852 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 408/803] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:11 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:12.066335 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-47c00cd2-db5b-402c-94de-a8ea6e1c7161 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:12.074340 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-47c00cd2-db5b-402c-94de-a8ea6e1c7161 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:12.075862 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-47c00cd2-db5b-402c-94de-a8ea6e1c7161 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:12.076945 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-47c00cd2-db5b-402c-94de-a8ea6e1c7161 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1407 microversion: 2.20 time: 0.151947 Jun 20 18:53:12.077488 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 396/804] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:53:11 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:53:12.256122 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1e8c0b17-85ac-4994-a91a-f22d231215b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:12.256725 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1e8c0b17-85ac-4994-a91a-f22d231215b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:12.262773 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1e8c0b17-85ac-4994-a91a-f22d231215b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:12.263247 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1e8c0b17-85ac-4994-a91a-f22d231215b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:12.263999 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1e8c0b17-85ac-4994-a91a-f22d231215b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:12.264436 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1e8c0b17-85ac-4994-a91a-f22d231215b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:12.393148 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1e8c0b17-85ac-4994-a91a-f22d231215b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:12.401416 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1e8c0b17-85ac-4994-a91a-f22d231215b7 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.149162 Jun 20 18:53:12.401975 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 409/805] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:12 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:12.937675 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-14d14a9f-56c8-41e7-9e40-fc733cee5d5d req-19005abd-98c4-4dbe-a0df-e3e3ebc715a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb97000-4705-4f02-bdd0-00047a203abf", "name": "network-vif-plugged", "status": "completed", "tag": "d20d672a-4e79-42b8-b764-55a554f24b8b"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:12.946763 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-14d14a9f-56c8-41e7-9e40-fc733cee5d5d req-19005abd-98c4-4dbe-a0df-e3e3ebc715a7 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:12.947242 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-14d14a9f-56c8-41e7-9e40-fc733cee5d5d req-19005abd-98c4-4dbe-a0df-e3e3ebc715a7 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:12.958122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-14d14a9f-56c8-41e7-9e40-fc733cee5d5d req-19005abd-98c4-4dbe-a0df-e3e3ebc715a7 service nova] Creating event network-vif-plugged:d20d672a-4e79-42b8-b764-55a554f24b8b for instance dcb97000-4705-4f02-bdd0-00047a203abf on hv-cinder-83697 Jun 20 18:53:12.963567 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-14d14a9f-56c8-41e7-9e40-fc733cee5d5d req-19005abd-98c4-4dbe-a0df-e3e3ebc715a7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029440 Jun 20 18:53:12.964214 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 397/806] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:53:13.054720 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0a834161-a74e-4ad4-ac45-d1f735a47d42 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:13.055396 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0a834161-a74e-4ad4-ac45-d1f735a47d42 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:13.061829 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0a834161-a74e-4ad4-ac45-d1f735a47d42 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:13.062277 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0a834161-a74e-4ad4-ac45-d1f735a47d42 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:13.063063 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0a834161-a74e-4ad4-ac45-d1f735a47d42 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:13.063495 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0a834161-a74e-4ad4-ac45-d1f735a47d42 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:13.094217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-3f765eb0-0734-4937-af1c-1d6e91f03da4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:13.094927 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-3f765eb0-0734-4937-af1c-1d6e91f03da4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:13.101161 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3f765eb0-0734-4937-af1c-1d6e91f03da4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:13.101630 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3f765eb0-0734-4937-af1c-1d6e91f03da4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:13.102391 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3f765eb0-0734-4937-af1c-1d6e91f03da4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:13.102825 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3f765eb0-0734-4937-af1c-1d6e91f03da4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:13.106956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:13.194440 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0a834161-a74e-4ad4-ac45-d1f735a47d42 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:13.202070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0a834161-a74e-4ad4-ac45-d1f735a47d42 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.151208 Jun 20 18:53:13.202731 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 410/807] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:13 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:13.233350 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-3f765eb0-0734-4937-af1c-1d6e91f03da4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:13.241200 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-3f765eb0-0734-4937-af1c-1d6e91f03da4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:13.242716 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-3f765eb0-0734-4937-af1c-1d6e91f03da4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:13.243830 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-3f765eb0-0734-4937-af1c-1d6e91f03da4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1407 microversion: 2.20 time: 0.153955 Jun 20 18:53:13.244378 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 398/808] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:53:13 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:53:13.419417 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c923cae8-5f6b-49cf-a9a4-164c9621074f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:13.420021 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c923cae8-5f6b-49cf-a9a4-164c9621074f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:13.425896 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c923cae8-5f6b-49cf-a9a4-164c9621074f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:13.426337 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c923cae8-5f6b-49cf-a9a4-164c9621074f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:13.427115 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c923cae8-5f6b-49cf-a9a4-164c9621074f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:13.427546 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c923cae8-5f6b-49cf-a9a4-164c9621074f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:13.555983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c923cae8-5f6b-49cf-a9a4-164c9621074f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:13.558219 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:13.565861 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c923cae8-5f6b-49cf-a9a4-164c9621074f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.150215 Jun 20 18:53:13.566437 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 411/809] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:13 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:14.219579 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-11fe6609-c53d-4b57-a297-73e7b57c88e6 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:14.220190 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-11fe6609-c53d-4b57-a297-73e7b57c88e6 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:14.222272 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:14.228851 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11fe6609-c53d-4b57-a297-73e7b57c88e6 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:14.229381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11fe6609-c53d-4b57-a297-73e7b57c88e6 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:14.230131 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11fe6609-c53d-4b57-a297-73e7b57c88e6 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:14.230712 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-11fe6609-c53d-4b57-a297-73e7b57c88e6 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:14.261010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-136c0e35-b4e3-4040-bd12-f5e67b0ecf89 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:14.261706 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-136c0e35-b4e3-4040-bd12-f5e67b0ecf89 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:14.263657 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=22 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:14.269482 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-136c0e35-b4e3-4040-bd12-f5e67b0ecf89 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:14.269931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-136c0e35-b4e3-4040-bd12-f5e67b0ecf89 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:14.270696 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-136c0e35-b4e3-4040-bd12-f5e67b0ecf89 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:14.271154 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-136c0e35-b4e3-4040-bd12-f5e67b0ecf89 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:14.360606 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-11fe6609-c53d-4b57-a297-73e7b57c88e6 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:14.369138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-11fe6609-c53d-4b57-a297-73e7b57c88e6 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.153379 Jun 20 18:53:14.369701 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 399/810] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:14 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:14.403380 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-136c0e35-b4e3-4040-bd12-f5e67b0ecf89 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:14.411224 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-136c0e35-b4e3-4040-bd12-f5e67b0ecf89 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:14.412726 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-136c0e35-b4e3-4040-bd12-f5e67b0ecf89 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:14.414564 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-136c0e35-b4e3-4040-bd12-f5e67b0ecf89 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1407 microversion: 2.20 time: 0.156714 Jun 20 18:53:14.415150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 412/811] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:53:14 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:53:14.582571 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0a9e5dd6-d910-4a89-9e5e-cc3fbd2f2ace tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:14.583158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0a9e5dd6-d910-4a89-9e5e-cc3fbd2f2ace tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:14.589705 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a9e5dd6-d910-4a89-9e5e-cc3fbd2f2ace tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:14.590152 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a9e5dd6-d910-4a89-9e5e-cc3fbd2f2ace tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:14.590932 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a9e5dd6-d910-4a89-9e5e-cc3fbd2f2ace tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:14.591374 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a9e5dd6-d910-4a89-9e5e-cc3fbd2f2ace tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:14.721761 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0a9e5dd6-d910-4a89-9e5e-cc3fbd2f2ace tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:14.730276 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0a9e5dd6-d910-4a89-9e5e-cc3fbd2f2ace tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.151607 Jun 20 18:53:14.730830 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 400/812] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:14 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:15.385460 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7546ebbd-a362-48be-b3ff-fffa1e3d4db3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:15.386067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7546ebbd-a362-48be-b3ff-fffa1e3d4db3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:15.392532 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7546ebbd-a362-48be-b3ff-fffa1e3d4db3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:15.392973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7546ebbd-a362-48be-b3ff-fffa1e3d4db3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:15.393722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7546ebbd-a362-48be-b3ff-fffa1e3d4db3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:15.394152 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7546ebbd-a362-48be-b3ff-fffa1e3d4db3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:15.432253 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-552f7224-e63d-42fd-ad1f-aeee4f58f995 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:15.432872 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-552f7224-e63d-42fd-ad1f-aeee4f58f995 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:15.439605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-552f7224-e63d-42fd-ad1f-aeee4f58f995 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:15.440054 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-552f7224-e63d-42fd-ad1f-aeee4f58f995 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:15.440826 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-552f7224-e63d-42fd-ad1f-aeee4f58f995 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:15.441263 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-552f7224-e63d-42fd-ad1f-aeee4f58f995 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:15.525310 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7546ebbd-a362-48be-b3ff-fffa1e3d4db3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:15.532819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7546ebbd-a362-48be-b3ff-fffa1e3d4db3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.151165 Jun 20 18:53:15.533383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 413/813] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:15 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:15.569670 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-552f7224-e63d-42fd-ad1f-aeee4f58f995 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:15.577813 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-552f7224-e63d-42fd-ad1f-aeee4f58f995 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:15.579382 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-552f7224-e63d-42fd-ad1f-aeee4f58f995 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:15.580485 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-552f7224-e63d-42fd-ad1f-aeee4f58f995 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1407 microversion: 2.20 time: 0.152185 Jun 20 18:53:15.581036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 401/814] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:53:15 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:53:15.746437 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1161c837-ad24-4a9a-8dea-ff368f646447 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:15.747151 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1161c837-ad24-4a9a-8dea-ff368f646447 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:15.753144 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1161c837-ad24-4a9a-8dea-ff368f646447 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:15.753589 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1161c837-ad24-4a9a-8dea-ff368f646447 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:15.754341 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1161c837-ad24-4a9a-8dea-ff368f646447 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:15.754769 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1161c837-ad24-4a9a-8dea-ff368f646447 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:15.880438 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1161c837-ad24-4a9a-8dea-ff368f646447 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:15.888759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1161c837-ad24-4a9a-8dea-ff368f646447 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1735 microversion: 2.1 time: 0.146260 Jun 20 18:53:15.889309 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 414/815] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:15 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:16.550840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1bfd2dc3-45bc-4bb9-8315-71028586a808 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:16.551473 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1bfd2dc3-45bc-4bb9-8315-71028586a808 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:16.558552 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1bfd2dc3-45bc-4bb9-8315-71028586a808 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:16.559024 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1bfd2dc3-45bc-4bb9-8315-71028586a808 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:16.559775 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1bfd2dc3-45bc-4bb9-8315-71028586a808 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:16.560201 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1bfd2dc3-45bc-4bb9-8315-71028586a808 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:16.598667 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-57d468fa-e366-46d9-9af5-dd600d3a1a5c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:16.599297 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-57d468fa-e366-46d9-9af5-dd600d3a1a5c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:16.605775 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-57d468fa-e366-46d9-9af5-dd600d3a1a5c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:16.606223 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-57d468fa-e366-46d9-9af5-dd600d3a1a5c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:16.606991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-57d468fa-e366-46d9-9af5-dd600d3a1a5c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:16.607419 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-57d468fa-e366-46d9-9af5-dd600d3a1a5c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:16.689406 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-1bfd2dc3-45bc-4bb9-8315-71028586a808 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:16.697515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1bfd2dc3-45bc-4bb9-8315-71028586a808 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.150424 Jun 20 18:53:16.698428 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 402/816] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:16 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:16.756786 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-57d468fa-e366-46d9-9af5-dd600d3a1a5c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:16.765546 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-57d468fa-e366-46d9-9af5-dd600d3a1a5c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:16.767329 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-57d468fa-e366-46d9-9af5-dd600d3a1a5c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:16.768581 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-57d468fa-e366-46d9-9af5-dd600d3a1a5c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1407 microversion: 2.20 time: 0.173819 Jun 20 18:53:16.769330 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 415/817] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:53:16 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:53:16.905982 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-471297ce-2021-4788-9e04-f9106fca5afe tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:16.907298 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-471297ce-2021-4788-9e04-f9106fca5afe tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:16.913260 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-471297ce-2021-4788-9e04-f9106fca5afe tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:16.914601 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-471297ce-2021-4788-9e04-f9106fca5afe tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:16.915387 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-471297ce-2021-4788-9e04-f9106fca5afe tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:16.915823 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-471297ce-2021-4788-9e04-f9106fca5afe tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:17.042235 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-471297ce-2021-4788-9e04-f9106fca5afe tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:17.050126 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-471297ce-2021-4788-9e04-f9106fca5afe tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1715 microversion: 2.1 time: 0.148500 Jun 20 18:53:17.050684 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 403/818] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:16 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1715 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:17.104067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-16347b2b-d768-4bf7-8d7a-0db19b579300 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:17.104629 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-16347b2b-d768-4bf7-8d7a-0db19b579300 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:17.110830 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-16347b2b-d768-4bf7-8d7a-0db19b579300 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:17.111318 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-16347b2b-d768-4bf7-8d7a-0db19b579300 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:17.112111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-16347b2b-d768-4bf7-8d7a-0db19b579300 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:17.112546 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-16347b2b-d768-4bf7-8d7a-0db19b579300 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:17.192027 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-16347b2b-d768-4bf7-8d7a-0db19b579300 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] HTTP exception thrown: Cannot 'detach_volume' instance f7fdf69c-2b2a-4801-82ca-54805176159b while it is in vm_state rescued Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-16347b2b-d768-4bf7-8d7a-0db19b579300 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Request method failure captured: Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: DELETE /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-volume_attachments/1da1cc46-7bd5-493f-b9c1-10b923921701 HTTP/1.1 Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMDgxGdD9NplnDOb9Kvkoi9z6IaPdYfKFk15cOFtxIEbZ3iM6js25CXsTI1b08r7rptp84JQv3s-L6cP6ceMNZuMSW6JZB2WSkrDda2t9Z9oJjBhawuAgtsiksYxhkCbb4o9vew5lG6pfzbGiHzTykEBsXAeqFgzCV--SlTvu97eD9o Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 7b4a919be31b4c74a3197d98ecec7fde Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:53:17.193643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:53:17.195846 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b4a919be31b4c74a3197d98ecec7fde", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b4a919be31b4c74a3197d98ecec7fde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b4a919be31b4c74a3197d98ecec7fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b4a919be31b4c74a3197d98ecec7fde"}]}] Jun 20 18:53:17.195846 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:53:17.195846 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 7b4a919be31b4c74a3197d98ecec7fde Jun 20 18:53:17.195846 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:53:17.195846 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-ServerRescueNegativeTestJSON-905734882-project Jun 20 18:53:17.195846 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:53:17.195846 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:53:17.195846 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 31fed190cac24d1b8326425f737e220b Jun 20 18:53:17.195846 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-ServerRescueNegativeTestJSON-905734882-project Jun 20 18:53:17.195846 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:53:17.195846 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Cannot 'detach_volume' instance f7fdf69c-2b2a-4801-82ca-54805176159b while it is in vm_state rescued Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'server_id': 'f7fdf69c-2b2a-4801-82ca-54805176159b', 'id': '1da1cc46-7bd5-493f-b9c1-10b923921701'} Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f7fdf69c-2b2a-4801-82ca-54805176159b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:53:17.196660 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f7fdf69c-2b2a-4801-82ca-54805176159b while it is in vm_state rescued Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f7fdf69c-2b2a-4801-82ca-54805176159b while it is in vm_state rescued Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:17.198130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-16347b2b-d768-4bf7-8d7a-0db19b579300 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Returning 409 to user: Cannot 'detach_volume' instance f7fdf69c-2b2a-4801-82ca-54805176159b while it is in vm_state rescued {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:53:17.199478 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-16347b2b-d768-4bf7-8d7a-0db19b579300 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-volume_attachments/1da1cc46-7bd5-493f-b9c1-10b923921701" status: 409 len: 152 microversion: 2.1 time: 0.095599 Jun 20 18:53:17.199478 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 416/819] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jun 20 18:53:17 2022] DELETE /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-volume_attachments/1da1cc46-7bd5-493f-b9c1-10b923921701 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 18:53:17.204364 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6666d671-1413-4347-b8af-7fdf3b80aeb9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:17.204891 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6666d671-1413-4347-b8af-7fdf3b80aeb9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:17.210977 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6666d671-1413-4347-b8af-7fdf3b80aeb9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:17.211428 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6666d671-1413-4347-b8af-7fdf3b80aeb9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:17.212182 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6666d671-1413-4347-b8af-7fdf3b80aeb9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:17.212617 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6666d671-1413-4347-b8af-7fdf3b80aeb9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:17.274893 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6666d671-1413-4347-b8af-7fdf3b80aeb9 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "POST /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/action" status: 202 len: 0 microversion: 2.1 time: 0.074141 Jun 20 18:53:17.275539 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 404/820] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jun 20 18:53:17 2022] POST /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 18:53:17.283611 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3d6d7391-9587-44f7-8141-648cff66b512 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:17.284331 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-3d6d7391-9587-44f7-8141-648cff66b512 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:17.291808 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3d6d7391-9587-44f7-8141-648cff66b512 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:17.292251 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3d6d7391-9587-44f7-8141-648cff66b512 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:17.293005 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3d6d7391-9587-44f7-8141-648cff66b512 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:17.293434 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3d6d7391-9587-44f7-8141-648cff66b512 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:17.297294 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:17.417486 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-3d6d7391-9587-44f7-8141-648cff66b512 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:17.425240 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-3d6d7391-9587-44f7-8141-648cff66b512 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1723 microversion: 2.1 time: 0.145586 Jun 20 18:53:17.425783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 417/821] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:17 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:17.716524 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f80c4294-551f-4ae1-80fc-2dd979029f52 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:17.717233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f80c4294-551f-4ae1-80fc-2dd979029f52 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:17.724039 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f80c4294-551f-4ae1-80fc-2dd979029f52 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:17.724624 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f80c4294-551f-4ae1-80fc-2dd979029f52 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:17.725396 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f80c4294-551f-4ae1-80fc-2dd979029f52 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:17.725826 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f80c4294-551f-4ae1-80fc-2dd979029f52 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:17.787081 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a7485d58-f933-4b43-84de-23d66d15c5d6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:17.787709 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a7485d58-f933-4b43-84de-23d66d15c5d6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:17.795921 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a7485d58-f933-4b43-84de-23d66d15c5d6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:17.796526 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a7485d58-f933-4b43-84de-23d66d15c5d6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:17.797559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a7485d58-f933-4b43-84de-23d66d15c5d6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:17.798066 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a7485d58-f933-4b43-84de-23d66d15c5d6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:17.879735 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f80c4294-551f-4ae1-80fc-2dd979029f52 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:17.888776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f80c4294-551f-4ae1-80fc-2dd979029f52 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.177553 Jun 20 18:53:17.889342 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 405/822] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:17 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:18.080812 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a7485d58-f933-4b43-84de-23d66d15c5d6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:18.089254 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a7485d58-f933-4b43-84de-23d66d15c5d6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:18.090782 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a7485d58-f933-4b43-84de-23d66d15c5d6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:18.091944 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a7485d58-f933-4b43-84de-23d66d15c5d6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1599 microversion: 2.20 time: 0.309707 Jun 20 18:53:18.092498 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 418/823] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:53:17 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1599 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:53:18.109053 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-3738aa32-5d4f-49fa-a8d6-03213c3720b2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:18.109540 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-3738aa32-5d4f-49fa-a8d6-03213c3720b2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:18.115469 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3738aa32-5d4f-49fa-a8d6-03213c3720b2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:18.115908 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3738aa32-5d4f-49fa-a8d6-03213c3720b2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:18.116680 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3738aa32-5d4f-49fa-a8d6-03213c3720b2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:18.117106 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3738aa32-5d4f-49fa-a8d6-03213c3720b2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:18.196538 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-3738aa32-5d4f-49fa-a8d6-03213c3720b2 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091367 Jun 20 18:53:18.197124 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 406/824] 10.222.0.43 () {60 vars in 1315 bytes} [Mon Jun 20 18:53:18 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:53:18.443386 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-58d06166-8715-4894-a289-54d2a774b27e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:18.444166 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-58d06166-8715-4894-a289-54d2a774b27e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:18.450758 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-58d06166-8715-4894-a289-54d2a774b27e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:18.451235 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-58d06166-8715-4894-a289-54d2a774b27e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:18.451996 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-58d06166-8715-4894-a289-54d2a774b27e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:18.452431 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-58d06166-8715-4894-a289-54d2a774b27e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:18.580640 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-58d06166-8715-4894-a289-54d2a774b27e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:18.588721 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-58d06166-8715-4894-a289-54d2a774b27e tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1723 microversion: 2.1 time: 0.149256 Jun 20 18:53:18.589291 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 419/825] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:18 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:18.906414 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8dbd2029-2551-43ac-8208-bbd4e8690319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:18.907060 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8dbd2029-2551-43ac-8208-bbd4e8690319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:18.914287 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8dbd2029-2551-43ac-8208-bbd4e8690319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:18.915035 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8dbd2029-2551-43ac-8208-bbd4e8690319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:18.915881 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8dbd2029-2551-43ac-8208-bbd4e8690319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:18.916389 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8dbd2029-2551-43ac-8208-bbd4e8690319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:19.133719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8dbd2029-2551-43ac-8208-bbd4e8690319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:19.141582 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8dbd2029-2551-43ac-8208-bbd4e8690319 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.239739 Jun 20 18:53:19.142154 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 407/826] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:18 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:19.173846 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-98b074c2-db71-48bb-9525-326f77cbf33e req-6f02390f-3e35-4373-a64b-1f3618ff93f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb97000-4705-4f02-bdd0-00047a203abf", "tag": "d20d672a-4e79-42b8-b764-55a554f24b8b"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:19.182502 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-98b074c2-db71-48bb-9525-326f77cbf33e req-6f02390f-3e35-4373-a64b-1f3618ff93f4 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:19.182970 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-98b074c2-db71-48bb-9525-326f77cbf33e req-6f02390f-3e35-4373-a64b-1f3618ff93f4 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:19.194002 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-98b074c2-db71-48bb-9525-326f77cbf33e req-6f02390f-3e35-4373-a64b-1f3618ff93f4 service nova] Creating event network-changed:d20d672a-4e79-42b8-b764-55a554f24b8b for instance dcb97000-4705-4f02-bdd0-00047a203abf on hv-cinder-83697 Jun 20 18:53:19.199086 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-98b074c2-db71-48bb-9525-326f77cbf33e req-6f02390f-3e35-4373-a64b-1f3618ff93f4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028929 Jun 20 18:53:19.199863 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 420/827] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:53:19.605658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-33823e99-2367-4043-befd-422ab9bf2770 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:19.606254 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-33823e99-2367-4043-befd-422ab9bf2770 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:19.612213 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-33823e99-2367-4043-befd-422ab9bf2770 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:19.612659 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-33823e99-2367-4043-befd-422ab9bf2770 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:19.613413 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-33823e99-2367-4043-befd-422ab9bf2770 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:19.613839 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-33823e99-2367-4043-befd-422ab9bf2770 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:19.749740 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-33823e99-2367-4043-befd-422ab9bf2770 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:19.759659 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-33823e99-2367-4043-befd-422ab9bf2770 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1723 microversion: 2.1 time: 0.157828 Jun 20 18:53:19.760514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 408/828] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:19 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:20.161759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0c17525c-fa2a-451b-9c68-11d7dbe7d633 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:20.162456 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0c17525c-fa2a-451b-9c68-11d7dbe7d633 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:20.169798 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0c17525c-fa2a-451b-9c68-11d7dbe7d633 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:20.170242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0c17525c-fa2a-451b-9c68-11d7dbe7d633 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:20.171044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0c17525c-fa2a-451b-9c68-11d7dbe7d633 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:20.171478 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0c17525c-fa2a-451b-9c68-11d7dbe7d633 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:20.449714 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0c17525c-fa2a-451b-9c68-11d7dbe7d633 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:20.457273 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0c17525c-fa2a-451b-9c68-11d7dbe7d633 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.301173 Jun 20 18:53:20.457830 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 421/829] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:20 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:20.778037 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ae9fbe74-132e-4ad7-b077-f9b65a80c692 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:20.778649 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ae9fbe74-132e-4ad7-b077-f9b65a80c692 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:20.785210 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ae9fbe74-132e-4ad7-b077-f9b65a80c692 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:20.785652 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ae9fbe74-132e-4ad7-b077-f9b65a80c692 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:20.786406 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ae9fbe74-132e-4ad7-b077-f9b65a80c692 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:20.786837 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ae9fbe74-132e-4ad7-b077-f9b65a80c692 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:20.920613 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ae9fbe74-132e-4ad7-b077-f9b65a80c692 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:20.928595 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ae9fbe74-132e-4ad7-b077-f9b65a80c692 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1723 microversion: 2.1 time: 0.155440 Jun 20 18:53:20.929158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 409/830] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:20 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:21.568466 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-da6f28a7-7aac-4e2b-9570-23220ea780de tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:21.569283 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-da6f28a7-7aac-4e2b-9570-23220ea780de tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:21.576243 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-da6f28a7-7aac-4e2b-9570-23220ea780de tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:21.576715 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-da6f28a7-7aac-4e2b-9570-23220ea780de tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:21.577473 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-da6f28a7-7aac-4e2b-9570-23220ea780de tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:21.577907 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-da6f28a7-7aac-4e2b-9570-23220ea780de tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:21.710359 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-da6f28a7-7aac-4e2b-9570-23220ea780de tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:21.717827 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-da6f28a7-7aac-4e2b-9570-23220ea780de tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1507 microversion: 2.1 time: 0.248224 Jun 20 18:53:21.718388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 422/831] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:21 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:21.734422 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e06838f7-0d66-40b8-8511-8be504cb5544 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:21.735026 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e06838f7-0d66-40b8-8511-8be504cb5544 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:21.740948 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e06838f7-0d66-40b8-8511-8be504cb5544 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:21.741385 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e06838f7-0d66-40b8-8511-8be504cb5544 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:21.742713 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e06838f7-0d66-40b8-8511-8be504cb5544 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:21.743195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e06838f7-0d66-40b8-8511-8be504cb5544 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:21.815052 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e06838f7-0d66-40b8-8511-8be504cb5544 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "POST /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459/action" status: 202 len: 0 microversion: 2.1 time: 0.084404 Jun 20 18:53:21.816300 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 410/832] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jun 20 18:53:21 2022] POST /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:53:21.824358 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-673350b8-ea69-4921-b75f-8971afddb820 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:21.824969 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-673350b8-ea69-4921-b75f-8971afddb820 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:21.830872 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-673350b8-ea69-4921-b75f-8971afddb820 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:21.831567 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-673350b8-ea69-4921-b75f-8971afddb820 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:21.832338 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-673350b8-ea69-4921-b75f-8971afddb820 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:21.832779 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-673350b8-ea69-4921-b75f-8971afddb820 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:21.946223 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-656d1219-bde2-4ec7-bc82-35b23e349fe6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:21.946835 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-656d1219-bde2-4ec7-bc82-35b23e349fe6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:21.953243 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-656d1219-bde2-4ec7-bc82-35b23e349fe6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:21.953701 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-656d1219-bde2-4ec7-bc82-35b23e349fe6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:21.954472 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-656d1219-bde2-4ec7-bc82-35b23e349fe6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:21.954906 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-656d1219-bde2-4ec7-bc82-35b23e349fe6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:21.965141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-673350b8-ea69-4921-b75f-8971afddb820 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:21.975395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-673350b8-ea69-4921-b75f-8971afddb820 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1515 microversion: 2.1 time: 0.154864 Jun 20 18:53:21.976097 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 423/833] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:21 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:22.087011 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-656d1219-bde2-4ec7-bc82-35b23e349fe6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:22.095083 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-656d1219-bde2-4ec7-bc82-35b23e349fe6 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1723 microversion: 2.1 time: 0.153361 Jun 20 18:53:22.095724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 411/834] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:21 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:53:22.875703 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-a3c064ae-e7e7-4395-953f-ff4ad92a3165 req-bfe0a091-7582-483a-a072-82102673752f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85165412-e44c-453d-aa22-d248bff1a459", "name": "network-vif-unplugged", "status": "completed", "tag": "12fa4b8e-1393-46da-afb1-ff594d0231e6"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:22.884958 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-a3c064ae-e7e7-4395-953f-ff4ad92a3165 req-bfe0a091-7582-483a-a072-82102673752f service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:22.885489 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-a3c064ae-e7e7-4395-953f-ff4ad92a3165 req-bfe0a091-7582-483a-a072-82102673752f service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:22.897049 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.compute.server_external_events [req-a3c064ae-e7e7-4395-953f-ff4ad92a3165 req-bfe0a091-7582-483a-a072-82102673752f service nova] Unable to find a host for instance 85165412-e44c-453d-aa22-d248bff1a459. Dropping event network-vif-unplugged {{(pid=124189) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 18:53:22.897957 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-a3c064ae-e7e7-4395-953f-ff4ad92a3165 req-bfe0a091-7582-483a-a072-82102673752f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026133 Jun 20 18:53:22.898522 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 424/835] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 20 18:53:22.993054 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9d3a8abb-4e12-4183-906b-758e96cd2ab3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:22.993650 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9d3a8abb-4e12-4183-906b-758e96cd2ab3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:23.000114 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9d3a8abb-4e12-4183-906b-758e96cd2ab3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:23.000552 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9d3a8abb-4e12-4183-906b-758e96cd2ab3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:23.001300 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9d3a8abb-4e12-4183-906b-758e96cd2ab3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:23.001725 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9d3a8abb-4e12-4183-906b-758e96cd2ab3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:23.113991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d5f7c009-45b6-4231-b8c3-ff8404a2a0d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:23.114889 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d5f7c009-45b6-4231-b8c3-ff8404a2a0d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:23.122313 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d5f7c009-45b6-4231-b8c3-ff8404a2a0d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:23.122768 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d5f7c009-45b6-4231-b8c3-ff8404a2a0d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:23.123734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d5f7c009-45b6-4231-b8c3-ff8404a2a0d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:23.124176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d5f7c009-45b6-4231-b8c3-ff8404a2a0d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:23.266704 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d5f7c009-45b6-4231-b8c3-ff8404a2a0d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:23.275916 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d5f7c009-45b6-4231-b8c3-ff8404a2a0d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1723 microversion: 2.1 time: 0.166637 Jun 20 18:53:23.276507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 425/836] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:23 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:53:23.372427 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9d3a8abb-4e12-4183-906b-758e96cd2ab3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:23.380035 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9d3a8abb-4e12-4183-906b-758e96cd2ab3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1515 microversion: 2.1 time: 0.391414 Jun 20 18:53:23.380594 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 412/837] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:22 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1515 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:24.293016 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8496208a-897a-4fe0-857c-61d54d1e93e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:24.293620 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8496208a-897a-4fe0-857c-61d54d1e93e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:24.300254 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8496208a-897a-4fe0-857c-61d54d1e93e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:24.300695 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8496208a-897a-4fe0-857c-61d54d1e93e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:24.301448 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8496208a-897a-4fe0-857c-61d54d1e93e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:24.301886 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8496208a-897a-4fe0-857c-61d54d1e93e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:24.397324 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e001504f-1677-4e96-b1f1-3ea4e91d9737 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:24.398004 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e001504f-1677-4e96-b1f1-3ea4e91d9737 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:24.405043 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e001504f-1677-4e96-b1f1-3ea4e91d9737 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:24.405485 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e001504f-1677-4e96-b1f1-3ea4e91d9737 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:24.406248 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e001504f-1677-4e96-b1f1-3ea4e91d9737 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:24.406706 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e001504f-1677-4e96-b1f1-3ea4e91d9737 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:24.410774 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:24.429573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8496208a-897a-4fe0-857c-61d54d1e93e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:24.437599 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8496208a-897a-4fe0-857c-61d54d1e93e3 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1729 microversion: 2.1 time: 0.148672 Jun 20 18:53:24.438166 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 426/838] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:24 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:24.454486 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-665d0d7d-ef6f-4565-a1cf-26d137a9222f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:24.455004 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-665d0d7d-ef6f-4565-a1cf-26d137a9222f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:24.461001 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-665d0d7d-ef6f-4565-a1cf-26d137a9222f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:24.461451 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-665d0d7d-ef6f-4565-a1cf-26d137a9222f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:24.462228 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-665d0d7d-ef6f-4565-a1cf-26d137a9222f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:24.462665 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-665d0d7d-ef6f-4565-a1cf-26d137a9222f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:24.541535 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e001504f-1677-4e96-b1f1-3ea4e91d9737 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:24.542548 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-665d0d7d-ef6f-4565-a1cf-26d137a9222f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091784 Jun 20 18:53:24.543237 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 427/839] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jun 20 18:53:24 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:53:24.549750 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e001504f-1677-4e96-b1f1-3ea4e91d9737 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1573 microversion: 2.1 time: 0.156119 Jun 20 18:53:24.550361 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 413/840] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:24 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:53:25.406367 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-c1953f76-e12f-4861-82a5-11cc915cbd3f req-8b7bbc12-f54b-4fcb-80fe-ca85e08ec224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7fdf69c-2b2a-4801-82ca-54805176159b", "tag": "cbfc3863-3fe2-440b-acc3-803dbc08a337"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:25.415239 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-c1953f76-e12f-4861-82a5-11cc915cbd3f req-8b7bbc12-f54b-4fcb-80fe-ca85e08ec224 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:25.415898 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-c1953f76-e12f-4861-82a5-11cc915cbd3f req-8b7bbc12-f54b-4fcb-80fe-ca85e08ec224 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:25.427222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-c1953f76-e12f-4861-82a5-11cc915cbd3f req-8b7bbc12-f54b-4fcb-80fe-ca85e08ec224 service nova] Creating event network-changed:cbfc3863-3fe2-440b-acc3-803dbc08a337 for instance f7fdf69c-2b2a-4801-82ca-54805176159b on hv-cinder-83697 Jun 20 18:53:25.433007 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-c1953f76-e12f-4861-82a5-11cc915cbd3f req-8b7bbc12-f54b-4fcb-80fe-ca85e08ec224 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030689 Jun 20 18:53:25.433944 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 428/841] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:53:25.567451 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8665f2e8-e416-4ba9-a128-7a33d73d79f5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:25.568068 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8665f2e8-e416-4ba9-a128-7a33d73d79f5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:25.574933 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8665f2e8-e416-4ba9-a128-7a33d73d79f5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:25.575397 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8665f2e8-e416-4ba9-a128-7a33d73d79f5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:25.576153 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8665f2e8-e416-4ba9-a128-7a33d73d79f5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:25.576581 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8665f2e8-e416-4ba9-a128-7a33d73d79f5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:25.709464 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8665f2e8-e416-4ba9-a128-7a33d73d79f5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:25.718084 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8665f2e8-e416-4ba9-a128-7a33d73d79f5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1573 microversion: 2.1 time: 0.154312 Jun 20 18:53:25.718569 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 414/842] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:25 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:26.735694 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f1159b05-6948-4252-9c49-8e56f7f2b08c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:26.736380 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f1159b05-6948-4252-9c49-8e56f7f2b08c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:26.743003 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f1159b05-6948-4252-9c49-8e56f7f2b08c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:26.743443 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f1159b05-6948-4252-9c49-8e56f7f2b08c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:26.744185 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f1159b05-6948-4252-9c49-8e56f7f2b08c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:26.744611 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f1159b05-6948-4252-9c49-8e56f7f2b08c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:26.873441 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f1159b05-6948-4252-9c49-8e56f7f2b08c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:26.880891 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f1159b05-6948-4252-9c49-8e56f7f2b08c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1573 microversion: 2.1 time: 0.149886 Jun 20 18:53:26.881446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 429/843] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:26 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:27.447727 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-eb8db013-3a96-42d8-9d9b-54cf668cb803 req-b914bdac-9a61-43b6-aeef-35b46211e7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7fdf69c-2b2a-4801-82ca-54805176159b", "tag": "cbfc3863-3fe2-440b-acc3-803dbc08a337"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:27.456238 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-eb8db013-3a96-42d8-9d9b-54cf668cb803 req-b914bdac-9a61-43b6-aeef-35b46211e7f6 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:27.456678 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-eb8db013-3a96-42d8-9d9b-54cf668cb803 req-b914bdac-9a61-43b6-aeef-35b46211e7f6 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:27.467535 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-eb8db013-3a96-42d8-9d9b-54cf668cb803 req-b914bdac-9a61-43b6-aeef-35b46211e7f6 service nova] Creating event network-changed:cbfc3863-3fe2-440b-acc3-803dbc08a337 for instance f7fdf69c-2b2a-4801-82ca-54805176159b on hv-cinder-83697 Jun 20 18:53:27.472395 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-eb8db013-3a96-42d8-9d9b-54cf668cb803 req-b914bdac-9a61-43b6-aeef-35b46211e7f6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028944 Jun 20 18:53:27.472948 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 415/844] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:53:27.898066 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9a3894d6-f95a-4d3f-8519-fb9df7aca2bd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:27.898673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9a3894d6-f95a-4d3f-8519-fb9df7aca2bd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:27.905080 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9a3894d6-f95a-4d3f-8519-fb9df7aca2bd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:27.905742 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9a3894d6-f95a-4d3f-8519-fb9df7aca2bd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:27.906504 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9a3894d6-f95a-4d3f-8519-fb9df7aca2bd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:27.906955 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9a3894d6-f95a-4d3f-8519-fb9df7aca2bd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:28.098428 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9a3894d6-f95a-4d3f-8519-fb9df7aca2bd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:28.106690 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9a3894d6-f95a-4d3f-8519-fb9df7aca2bd tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1573 microversion: 2.1 time: 0.212500 Jun 20 18:53:28.107283 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 430/845] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:27 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1573 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:29.124503 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-50423679-b0c6-4e46-b7c6-978b76b4f2e3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:29.125214 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-50423679-b0c6-4e46-b7c6-978b76b4f2e3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:29.131388 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-50423679-b0c6-4e46-b7c6-978b76b4f2e3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:29.131824 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-50423679-b0c6-4e46-b7c6-978b76b4f2e3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:29.133203 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-50423679-b0c6-4e46-b7c6-978b76b4f2e3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:29.133627 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-50423679-b0c6-4e46-b7c6-978b76b4f2e3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:29.260590 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-50423679-b0c6-4e46-b7c6-978b76b4f2e3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:29.268103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-50423679-b0c6-4e46-b7c6-978b76b4f2e3 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1573 microversion: 2.1 time: 0.148217 Jun 20 18:53:29.268655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 416/846] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:29 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:30.284836 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-930cd885-a55d-4992-8058-5f40cf52111d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:30.285443 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-930cd885-a55d-4992-8058-5f40cf52111d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:30.292658 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-930cd885-a55d-4992-8058-5f40cf52111d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:30.293108 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-930cd885-a55d-4992-8058-5f40cf52111d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:30.293930 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-930cd885-a55d-4992-8058-5f40cf52111d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:30.294364 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-930cd885-a55d-4992-8058-5f40cf52111d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:30.421360 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-930cd885-a55d-4992-8058-5f40cf52111d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:30.428747 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-930cd885-a55d-4992-8058-5f40cf52111d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1573 microversion: 2.1 time: 0.147768 Jun 20 18:53:30.429305 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 431/847] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:30 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:31.446085 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4a3a672a-4bf9-4c00-b05c-57a61dbeb6bf tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:31.446684 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-4a3a672a-4bf9-4c00-b05c-57a61dbeb6bf tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:31.453124 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a3a672a-4bf9-4c00-b05c-57a61dbeb6bf tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:31.453561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a3a672a-4bf9-4c00-b05c-57a61dbeb6bf tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:31.454307 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a3a672a-4bf9-4c00-b05c-57a61dbeb6bf tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:31.454733 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4a3a672a-4bf9-4c00-b05c-57a61dbeb6bf tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:31.581743 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4a3a672a-4bf9-4c00-b05c-57a61dbeb6bf tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:31.589199 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4a3a672a-4bf9-4c00-b05c-57a61dbeb6bf tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1573 microversion: 2.1 time: 0.147597 Jun 20 18:53:31.589756 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 417/848] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:31 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:32.606433 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d6e939f9-0b79-4929-b9f2-f90daa83fe82 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:32.606994 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d6e939f9-0b79-4929-b9f2-f90daa83fe82 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:32.613445 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6e939f9-0b79-4929-b9f2-f90daa83fe82 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:32.613889 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6e939f9-0b79-4929-b9f2-f90daa83fe82 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:32.614639 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6e939f9-0b79-4929-b9f2-f90daa83fe82 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:32.615112 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d6e939f9-0b79-4929-b9f2-f90daa83fe82 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:32.746754 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d6e939f9-0b79-4929-b9f2-f90daa83fe82 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:32.754217 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d6e939f9-0b79-4929-b9f2-f90daa83fe82 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1573 microversion: 2.1 time: 0.151733 Jun 20 18:53:32.754769 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 432/849] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:32 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:33.771604 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-65865242-2895-4ee7-8933-378ce489324c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:33.772251 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-65865242-2895-4ee7-8933-378ce489324c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:33.778813 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-65865242-2895-4ee7-8933-378ce489324c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:33.779293 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-65865242-2895-4ee7-8933-378ce489324c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:33.780079 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-65865242-2895-4ee7-8933-378ce489324c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:33.780508 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-65865242-2895-4ee7-8933-378ce489324c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:33.910067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-65865242-2895-4ee7-8933-378ce489324c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:33.918219 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-65865242-2895-4ee7-8933-378ce489324c tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1573 microversion: 2.1 time: 0.150441 Jun 20 18:53:33.918782 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 418/850] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:33 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:34.935694 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ee913631-f870-4d83-9665-a479907effd9 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:34.936639 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ee913631-f870-4d83-9665-a479907effd9 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:34.939250 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:34.945576 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ee913631-f870-4d83-9665-a479907effd9 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:34.946017 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ee913631-f870-4d83-9665-a479907effd9 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:34.946777 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ee913631-f870-4d83-9665-a479907effd9 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:34.947264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ee913631-f870-4d83-9665-a479907effd9 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:34.961553 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-9ede31de-a9f6-4121-849c-3e34a3a8b554 req-e7d4d9d6-7fcd-49e4-908c-eec40003a0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85165412-e44c-453d-aa22-d248bff1a459", "name": "network-vif-plugged", "status": "completed", "tag": "12fa4b8e-1393-46da-afb1-ff594d0231e6"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:34.973409 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-9ede31de-a9f6-4121-849c-3e34a3a8b554 req-e7d4d9d6-7fcd-49e4-908c-eec40003a0f1 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:34.974081 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-9ede31de-a9f6-4121-849c-3e34a3a8b554 req-e7d4d9d6-7fcd-49e4-908c-eec40003a0f1 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:34.986547 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-9ede31de-a9f6-4121-849c-3e34a3a8b554 req-e7d4d9d6-7fcd-49e4-908c-eec40003a0f1 service nova] Creating event network-vif-plugged:12fa4b8e-1393-46da-afb1-ff594d0231e6 for instance 85165412-e44c-453d-aa22-d248bff1a459 on hv-cinder-83697 Jun 20 18:53:34.992768 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-9ede31de-a9f6-4121-849c-3e34a3a8b554 req-e7d4d9d6-7fcd-49e4-908c-eec40003a0f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035344 Jun 20 18:53:34.993580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 419/851] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:53:35.089907 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ee913631-f870-4d83-9665-a479907effd9 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:35.097641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ee913631-f870-4d83-9665-a479907effd9 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1573 microversion: 2.1 time: 0.165749 Jun 20 18:53:35.098619 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 433/852] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:34 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:36.115986 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-692dea59-bdd5-45c0-8223-7172f5ddfdf5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:36.116685 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-692dea59-bdd5-45c0-8223-7172f5ddfdf5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:36.122826 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-692dea59-bdd5-45c0-8223-7172f5ddfdf5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:36.123301 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-692dea59-bdd5-45c0-8223-7172f5ddfdf5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:36.124056 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-692dea59-bdd5-45c0-8223-7172f5ddfdf5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:36.124487 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-692dea59-bdd5-45c0-8223-7172f5ddfdf5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:36.255862 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-692dea59-bdd5-45c0-8223-7172f5ddfdf5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:36.264024 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-692dea59-bdd5-45c0-8223-7172f5ddfdf5 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1573 microversion: 2.1 time: 0.152722 Jun 20 18:53:36.264581 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 420/853] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:36 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:36.501611 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-016ccd8f-fe25-40f3-b718-bfd198bae10a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-610668756"}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:36.502196 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-016ccd8f-fe25-40f3-b718-bfd198bae10a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:36.509283 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-016ccd8f-fe25-40f3-b718-bfd198bae10a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:36.509724 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-016ccd8f-fe25-40f3-b718-bfd198bae10a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:36.510478 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-016ccd8f-fe25-40f3-b718-bfd198bae10a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:36.510909 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-016ccd8f-fe25-40f3-b718-bfd198bae10a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:36.636458 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.network.security_group_api [None req-016ccd8f-fe25-40f3-b718-bfd198bae10a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Removing security group 1de9522c-dfaa-4f91-ae00-497c9ce282a6 from port 96708947-b2a6-41f9-8eb6-1a4bc89a1294 Jun 20 18:53:36.984576 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-016ccd8f-fe25-40f3-b718-bfd198bae10a tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "POST /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/action" status: 202 len: 0 microversion: 2.1 time: 0.486887 Jun 20 18:53:36.985366 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 434/854] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jun 20 18:53:36 2022] POST /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:53:36.996765 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-82205370-4bc8-453e-ad5c-dcd862000fc2 req-c65909f4-90eb-443e-8569-912b9c006c5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a42434-2efd-4f8e-b3fb-e77f0e99f072", "tag": "96708947-b2a6-41f9-8eb6-1a4bc89a1294"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:37.011250 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-82205370-4bc8-453e-ad5c-dcd862000fc2 req-c65909f4-90eb-443e-8569-912b9c006c5f service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:37.011541 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-82205370-4bc8-453e-ad5c-dcd862000fc2 req-c65909f4-90eb-443e-8569-912b9c006c5f service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:37.023278 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-82205370-4bc8-453e-ad5c-dcd862000fc2 req-c65909f4-90eb-443e-8569-912b9c006c5f service nova] Creating event network-changed:96708947-b2a6-41f9-8eb6-1a4bc89a1294 for instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 on hv-cinder-83697 Jun 20 18:53:37.028547 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-82205370-4bc8-453e-ad5c-dcd862000fc2 req-c65909f4-90eb-443e-8569-912b9c006c5f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035605 Jun 20 18:53:37.029145 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 421/855] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:53:37.282033 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-940ce743-ef04-4414-ac2d-75bfa2b1012e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:37.282748 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-940ce743-ef04-4414-ac2d-75bfa2b1012e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:37.291764 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-940ce743-ef04-4414-ac2d-75bfa2b1012e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:37.292842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-940ce743-ef04-4414-ac2d-75bfa2b1012e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:37.293297 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-940ce743-ef04-4414-ac2d-75bfa2b1012e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:37.293734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-940ce743-ef04-4414-ac2d-75bfa2b1012e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:37.788321 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-940ce743-ef04-4414-ac2d-75bfa2b1012e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:37.796281 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-940ce743-ef04-4414-ac2d-75bfa2b1012e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1560 microversion: 2.1 time: 0.519242 Jun 20 18:53:37.796851 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 435/856] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:37 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1560 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:38.726353 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7a52921f-52b1-49a9-a31f-ed2ffab4bcb6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:38.726955 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7a52921f-52b1-49a9-a31f-ed2ffab4bcb6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:38.733202 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7a52921f-52b1-49a9-a31f-ed2ffab4bcb6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:38.733656 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7a52921f-52b1-49a9-a31f-ed2ffab4bcb6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:38.734422 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7a52921f-52b1-49a9-a31f-ed2ffab4bcb6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:38.734861 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7a52921f-52b1-49a9-a31f-ed2ffab4bcb6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:38.817489 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-7a52921f-52b1-49a9-a31f-ed2ffab4bcb6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lazy-loading 'services' on Instance uuid b1a42434-2efd-4f8e-b3fb-e77f0e99f072 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:53:38.888156 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7a52921f-52b1-49a9-a31f-ed2ffab4bcb6 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/os-volume_attachments/18749aa8-d526-4554-ada6-05949098ec7a" status: 202 len: 0 microversion: 2.1 time: 0.166957 Jun 20 18:53:38.888749 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 422/857] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jun 20 18:53:38 2022] DELETE /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/os-volume_attachments/18749aa8-d526-4554-ada6-05949098ec7a => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:53:38.897174 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-446a488f-119e-43e0-a737-f34d5ff176f9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:38.898681 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-446a488f-119e-43e0-a737-f34d5ff176f9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:38.905193 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-446a488f-119e-43e0-a737-f34d5ff176f9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:38.905637 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-446a488f-119e-43e0-a737-f34d5ff176f9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:38.906402 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-446a488f-119e-43e0-a737-f34d5ff176f9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:38.906837 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-446a488f-119e-43e0-a737-f34d5ff176f9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:38.924441 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=100 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:38.938215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-446a488f-119e-43e0-a737-f34d5ff176f9 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044793 Jun 20 18:53:38.942254 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 436/858] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:53:38 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:53:39.044271 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-9a37aebb-1f61-47aa-b73f-5e7f4a70669c req-ddf531d3-b0c7-483e-87f1-e8d6f2acd7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a42434-2efd-4f8e-b3fb-e77f0e99f072", "tag": "96708947-b2a6-41f9-8eb6-1a4bc89a1294"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:39.052570 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-9a37aebb-1f61-47aa-b73f-5e7f4a70669c req-ddf531d3-b0c7-483e-87f1-e8d6f2acd7a3 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:39.053017 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-9a37aebb-1f61-47aa-b73f-5e7f4a70669c req-ddf531d3-b0c7-483e-87f1-e8d6f2acd7a3 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:39.064421 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-9a37aebb-1f61-47aa-b73f-5e7f4a70669c req-ddf531d3-b0c7-483e-87f1-e8d6f2acd7a3 service nova] Creating event network-changed:96708947-b2a6-41f9-8eb6-1a4bc89a1294 for instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 on hv-cinder-83697 Jun 20 18:53:39.069265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-9a37aebb-1f61-47aa-b73f-5e7f4a70669c req-ddf531d3-b0c7-483e-87f1-e8d6f2acd7a3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029067 Jun 20 18:53:39.069841 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 423/859] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:53:39.950999 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9dfcccb5-2a4e-4352-90e5-b34158cd3b61 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:39.951949 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9dfcccb5-2a4e-4352-90e5-b34158cd3b61 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:39.959193 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9dfcccb5-2a4e-4352-90e5-b34158cd3b61 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:39.959649 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9dfcccb5-2a4e-4352-90e5-b34158cd3b61 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:39.961007 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9dfcccb5-2a4e-4352-90e5-b34158cd3b61 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:39.961440 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9dfcccb5-2a4e-4352-90e5-b34158cd3b61 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:39.992813 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9dfcccb5-2a4e-4352-90e5-b34158cd3b61 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046445 Jun 20 18:53:39.993388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 437/860] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:53:39 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:53:41.005673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e6fd96a3-85f2-4dd8-9670-73ff535d7634 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:41.006713 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e6fd96a3-85f2-4dd8-9670-73ff535d7634 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:41.009279 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=66 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:41.014845 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e6fd96a3-85f2-4dd8-9670-73ff535d7634 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:41.015317 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e6fd96a3-85f2-4dd8-9670-73ff535d7634 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:41.016083 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e6fd96a3-85f2-4dd8-9670-73ff535d7634 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:41.016523 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e6fd96a3-85f2-4dd8-9670-73ff535d7634 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:41.044113 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e6fd96a3-85f2-4dd8-9670-73ff535d7634 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043360 Jun 20 18:53:41.044660 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 424/861] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:53:40 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 18:53:41.054884 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-157ce1cc-3ec6-47bf-999f-107e58c071a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:41.055375 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-157ce1cc-3ec6-47bf-999f-107e58c071a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:41.061734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-157ce1cc-3ec6-47bf-999f-107e58c071a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:41.062174 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-157ce1cc-3ec6-47bf-999f-107e58c071a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:41.062931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-157ce1cc-3ec6-47bf-999f-107e58c071a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:41.063371 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-157ce1cc-3ec6-47bf-999f-107e58c071a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:41.140051 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-157ce1cc-3ec6-47bf-999f-107e58c071a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] HTTP exception thrown: Instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 is not attached to volume 18749aa8-d526-4554-ada6-05949098ec7a Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-157ce1cc-3ec6-47bf-999f-107e58c071a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Request method failure captured: Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: DELETE /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/os-volume_attachments/18749aa8-d526-4554-ada6-05949098ec7a HTTP/1.1 Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMEGURhrZZZGgekyrvxcOYrCNt7_1kGBKgnOIZ3-HisxHIXDVxPvnoU5KprOxC1J-pnITuiikYl91Dbw7EHbFGHaCPWujGbX4rXtvpwzFH_37Q76JwpF62LBShvKcN8jqjMV11oqqXfCNdcUQBuymPBrYme2WqZXLAfYbgAJg0k4Ue4 Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 4b52def37b964824993a0edb3abc3413 Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-TestMinimumBasicScenario-1545604579 Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:53:41.142450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:53:41.144040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b52def37b964824993a0edb3abc3413", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b52def37b964824993a0edb3abc3413"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b52def37b964824993a0edb3abc3413"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b52def37b964824993a0edb3abc3413"}]}] Jun 20 18:53:41.144040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-TestMinimumBasicScenario-1545604579 Jun 20 18:53:41.144040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 4b52def37b964824993a0edb3abc3413 Jun 20 18:53:41.144040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1545604579 Jun 20 18:53:41.144040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-TestMinimumBasicScenario-1545604579-project Jun 20 18:53:41.144040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:53:41.144040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:53:41.144040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: b98488d018b04b34a6758f8b55925316 Jun 20 18:53:41.144040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-TestMinimumBasicScenario-1545604579-project Jun 20 18:53:41.144040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:53:41.144040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 is not attached to volume 18749aa8-d526-4554-ada6-05949098ec7a Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'server_id': 'b1a42434-2efd-4f8e-b3fb-e77f0e99f072', 'id': '18749aa8-d526-4554-ada6-05949098ec7a'} Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 18749aa8-d526-4554-ada6-05949098ec7a. Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:53:41.144883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 is not attached to volume 18749aa8-d526-4554-ada6-05949098ec7a Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 is not attached to volume 18749aa8-d526-4554-ada6-05949098ec7a Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:41.146179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-157ce1cc-3ec6-47bf-999f-107e58c071a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Returning 404 to user: Instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 is not attached to volume 18749aa8-d526-4554-ada6-05949098ec7a {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:53:41.147121 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-157ce1cc-3ec6-47bf-999f-107e58c071a2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/os-volume_attachments/18749aa8-d526-4554-ada6-05949098ec7a" status: 404 len: 154 microversion: 2.1 time: 0.093867 Jun 20 18:53:41.147121 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 438/862] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jun 20 18:53:41 2022] DELETE /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072/os-volume_attachments/18749aa8-d526-4554-ada6-05949098ec7a => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:53:42.276955 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f4399f04-3d72-4ea2-8938-6514ea67ecf2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:42.277447 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f4399f04-3d72-4ea2-8938-6514ea67ecf2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:42.286115 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f4399f04-3d72-4ea2-8938-6514ea67ecf2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:42.286565 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f4399f04-3d72-4ea2-8938-6514ea67ecf2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:42.287420 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f4399f04-3d72-4ea2-8938-6514ea67ecf2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:42.287853 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f4399f04-3d72-4ea2-8938-6514ea67ecf2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:42.312905 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f4399f04-3d72-4ea2-8938-6514ea67ecf2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:53:42.384793 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f4399f04-3d72-4ea2-8938-6514ea67ecf2 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 204 len: 0 microversion: 2.1 time: 0.111320 Jun 20 18:53:42.385423 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 425/863] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:53:42 2022] DELETE /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:53:42.394086 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-282f7585-2bc3-4e04-bd6d-7cd52f971e64 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:42.394690 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-282f7585-2bc3-4e04-bd6d-7cd52f971e64 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:42.401717 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-282f7585-2bc3-4e04-bd6d-7cd52f971e64 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:42.402157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-282f7585-2bc3-4e04-bd6d-7cd52f971e64 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:42.402906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-282f7585-2bc3-4e04-bd6d-7cd52f971e64 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:42.403439 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-282f7585-2bc3-4e04-bd6d-7cd52f971e64 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:42.533893 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-282f7585-2bc3-4e04-bd6d-7cd52f971e64 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:42.541707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-282f7585-2bc3-4e04-bd6d-7cd52f971e64 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1553 microversion: 2.1 time: 0.151522 Jun 20 18:53:42.542264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 439/864] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:42 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:43.657114 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b0b2535c-4f82-47ce-a682-f757da817393 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:43.657811 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b0b2535c-4f82-47ce-a682-f757da817393 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:43.664109 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b0b2535c-4f82-47ce-a682-f757da817393 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:43.664557 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b0b2535c-4f82-47ce-a682-f757da817393 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:43.665310 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b0b2535c-4f82-47ce-a682-f757da817393 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:43.665740 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b0b2535c-4f82-47ce-a682-f757da817393 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:43.793993 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b0b2535c-4f82-47ce-a682-f757da817393 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:43.801420 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b0b2535c-4f82-47ce-a682-f757da817393 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1553 microversion: 2.1 time: 0.246424 Jun 20 18:53:43.802003 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 426/865] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:43 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1553 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:44.817634 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1c3345de-abdf-449a-b2e5-c1a931d5db46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:44.818238 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1c3345de-abdf-449a-b2e5-c1a931d5db46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:44.824804 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1c3345de-abdf-449a-b2e5-c1a931d5db46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:44.825316 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1c3345de-abdf-449a-b2e5-c1a931d5db46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:44.826048 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1c3345de-abdf-449a-b2e5-c1a931d5db46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:44.826486 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1c3345de-abdf-449a-b2e5-c1a931d5db46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:44.952871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1c3345de-abdf-449a-b2e5-c1a931d5db46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:44.960782 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1c3345de-abdf-449a-b2e5-c1a931d5db46 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1553 microversion: 2.1 time: 0.147100 Jun 20 18:53:44.961339 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 440/866] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:44 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:45.456473 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-3bf23a17-8e38-44ba-b27e-524d9b25fe11 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:45.457521 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-3bf23a17-8e38-44ba-b27e-524d9b25fe11 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:45.464055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3bf23a17-8e38-44ba-b27e-524d9b25fe11 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:45.464508 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3bf23a17-8e38-44ba-b27e-524d9b25fe11 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:45.465278 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3bf23a17-8e38-44ba-b27e-524d9b25fe11 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:45.465714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3bf23a17-8e38-44ba-b27e-524d9b25fe11 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:45.495472 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-3bf23a17-8e38-44ba-b27e-524d9b25fe11 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042727 Jun 20 18:53:45.496133 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 427/867] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:53:45 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 18:53:45.575860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c67cffd0-2735-4dd0-b513-59a73e30dd45 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:45.576617 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c67cffd0-2735-4dd0-b513-59a73e30dd45 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:45.582752 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c67cffd0-2735-4dd0-b513-59a73e30dd45 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:45.583237 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c67cffd0-2735-4dd0-b513-59a73e30dd45 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:45.584008 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c67cffd0-2735-4dd0-b513-59a73e30dd45 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:45.584447 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c67cffd0-2735-4dd0-b513-59a73e30dd45 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:45.606905 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-d8b8e17a-e9c7-4b01-9317-a6130938fc8d req-c99b2dc4-61ec-4788-8143-aec40295da95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a42434-2efd-4f8e-b3fb-e77f0e99f072", "name": "network-vif-deleted", "tag": "96708947-b2a6-41f9-8eb6-1a4bc89a1294"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:45.611987 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c67cffd0-2735-4dd0-b513-59a73e30dd45 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Going to try to terminate instance {{(pid=124189) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:53:45.615452 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-d8b8e17a-e9c7-4b01-9317-a6130938fc8d req-c99b2dc4-61ec-4788-8143-aec40295da95 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:45.615903 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-d8b8e17a-e9c7-4b01-9317-a6130938fc8d req-c99b2dc4-61ec-4788-8143-aec40295da95 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:45.627545 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-d8b8e17a-e9c7-4b01-9317-a6130938fc8d req-c99b2dc4-61ec-4788-8143-aec40295da95 service nova] Creating event network-vif-deleted:96708947-b2a6-41f9-8eb6-1a4bc89a1294 for instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 on hv-cinder-83697 Jun 20 18:53:45.633447 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-d8b8e17a-e9c7-4b01-9317-a6130938fc8d req-c99b2dc4-61ec-4788-8143-aec40295da95 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030015 Jun 20 18:53:45.634282 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 428/868] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:53:45.693086 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c67cffd0-2735-4dd0-b513-59a73e30dd45 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 204 len: 0 microversion: 2.1 time: 0.122061 Jun 20 18:53:45.697509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 441/869] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:53:45 2022] DELETE /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:53:45.703367 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-cf3c7339-e6b0-42be-8a2d-28f7ad325ae9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:45.704240 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-cf3c7339-e6b0-42be-8a2d-28f7ad325ae9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:45.711180 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cf3c7339-e6b0-42be-8a2d-28f7ad325ae9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:45.711628 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cf3c7339-e6b0-42be-8a2d-28f7ad325ae9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:45.712606 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cf3c7339-e6b0-42be-8a2d-28f7ad325ae9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:45.713047 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-cf3c7339-e6b0-42be-8a2d-28f7ad325ae9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:45.844229 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-cf3c7339-e6b0-42be-8a2d-28f7ad325ae9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:45.851738 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-cf3c7339-e6b0-42be-8a2d-28f7ad325ae9 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1672 microversion: 2.1 time: 0.152957 Jun 20 18:53:45.852292 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 429/870] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:45 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:45.978997 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-31168a72-05af-48a9-a3ce-06d2b687ff58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:45.979719 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-31168a72-05af-48a9-a3ce-06d2b687ff58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:45.985915 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-31168a72-05af-48a9-a3ce-06d2b687ff58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:45.986356 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-31168a72-05af-48a9-a3ce-06d2b687ff58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:45.987145 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-31168a72-05af-48a9-a3ce-06d2b687ff58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:45.987574 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-31168a72-05af-48a9-a3ce-06d2b687ff58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:46.019239 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-31168a72-05af-48a9-a3ce-06d2b687ff58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:46.019681 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-31168a72-05af-48a9-a3ce-06d2b687ff58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:46.020115 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-31168a72-05af-48a9-a3ce-06d2b687ff58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lazy-loading 'fault' on Instance uuid b1a42434-2efd-4f8e-b3fb-e77f0e99f072 {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:53:46.061824 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-31168a72-05af-48a9-a3ce-06d2b687ff58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:46.069360 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-31168a72-05af-48a9-a3ce-06d2b687ff58 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1347 microversion: 2.1 time: 0.095389 Jun 20 18:53:46.069914 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 442/871] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:45 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1347 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:46.868824 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4d971fcb-4cac-42de-95f4-26dda7a0c5b7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:46.869409 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-4d971fcb-4cac-42de-95f4-26dda7a0c5b7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:46.875868 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4d971fcb-4cac-42de-95f4-26dda7a0c5b7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:46.876294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4d971fcb-4cac-42de-95f4-26dda7a0c5b7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:46.877045 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4d971fcb-4cac-42de-95f4-26dda7a0c5b7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:46.877473 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4d971fcb-4cac-42de-95f4-26dda7a0c5b7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:47.004397 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4d971fcb-4cac-42de-95f4-26dda7a0c5b7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:47.007921 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:47.012634 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4d971fcb-4cac-42de-95f4-26dda7a0c5b7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1672 microversion: 2.1 time: 0.147738 Jun 20 18:53:47.013193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 430/872] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:46 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:47.086293 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9c24a2be-11a2-4fd4-a601-42c076c3801f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:47.086958 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9c24a2be-11a2-4fd4-a601-42c076c3801f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:47.093459 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9c24a2be-11a2-4fd4-a601-42c076c3801f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:47.093908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9c24a2be-11a2-4fd4-a601-42c076c3801f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:47.094659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9c24a2be-11a2-4fd4-a601-42c076c3801f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:47.095122 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9c24a2be-11a2-4fd4-a601-42c076c3801f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:47.125141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9c24a2be-11a2-4fd4-a601-42c076c3801f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:47.125587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9c24a2be-11a2-4fd4-a601-42c076c3801f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:47.126467 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-9c24a2be-11a2-4fd4-a601-42c076c3801f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lazy-loading 'fault' on Instance uuid b1a42434-2efd-4f8e-b3fb-e77f0e99f072 {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:53:47.174906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9c24a2be-11a2-4fd4-a601-42c076c3801f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98488d018b04b34a6758f8b55925316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52def37b964824993a0edb3abc3413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:47.182151 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9c24a2be-11a2-4fd4-a601-42c076c3801f tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 200 len: 1347 microversion: 2.1 time: 0.100149 Jun 20 18:53:47.183063 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 443/873] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:47 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 1347 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:48.031259 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-de1d8398-0bb0-4140-bb91-74765ececd6f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:48.040595 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-de1d8398-0bb0-4140-bb91-74765ececd6f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:48.054640 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de1d8398-0bb0-4140-bb91-74765ececd6f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:48.055122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de1d8398-0bb0-4140-bb91-74765ececd6f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:48.055901 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de1d8398-0bb0-4140-bb91-74765ececd6f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:48.056751 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de1d8398-0bb0-4140-bb91-74765ececd6f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:48.123513 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-de1d8398-0bb0-4140-bb91-74765ececd6f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:48.132340 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-de1d8398-0bb0-4140-bb91-74765ececd6f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 200 len: 1605 microversion: 2.1 time: 0.105759 Jun 20 18:53:48.133241 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 431/874] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:48 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 1605 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:48.201600 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fb633ab1-8f75-4a17-a365-3ecdeb5a67ca tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:48.203050 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fb633ab1-8f75-4a17-a365-3ecdeb5a67ca tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] [instance: b1a42434-2efd-4f8e-b3fb-e77f0e99f072] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:48.210850 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb633ab1-8f75-4a17-a365-3ecdeb5a67ca tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:48.211454 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb633ab1-8f75-4a17-a365-3ecdeb5a67ca tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:48.212422 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb633ab1-8f75-4a17-a365-3ecdeb5a67ca tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:48.212792 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fb633ab1-8f75-4a17-a365-3ecdeb5a67ca tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:48.227747 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-fb633ab1-8f75-4a17-a365-3ecdeb5a67ca tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] HTTP exception thrown: Instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 could not be found. Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fb633ab1-8f75-4a17-a365-3ecdeb5a67ca tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Request method failure captured: Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 HTTP/1.1 Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMEGURhrZZZGgekyrvxcOYrCNt7_1kGBKgnOIZ3-HisxHIXDVxPvnoU5KprOxC1J-pnITuiikYl91Dbw7EHbFGHaCPWujGbX4rXtvpwzFH_37Q76JwpF62LBShvKcN8jqjMV11oqqXfCNdcUQBuymPBrYme2WqZXLAfYbgAJg0k4Ue4 Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 4b52def37b964824993a0edb3abc3413 Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-TestMinimumBasicScenario-1545604579 Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:53:48.229476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:53:48.231131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b52def37b964824993a0edb3abc3413", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b52def37b964824993a0edb3abc3413"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b52def37b964824993a0edb3abc3413"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b52def37b964824993a0edb3abc3413"}]}] Jun 20 18:53:48.231131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-TestMinimumBasicScenario-1545604579 Jun 20 18:53:48.231131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 4b52def37b964824993a0edb3abc3413 Jun 20 18:53:48.231131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1545604579 Jun 20 18:53:48.231131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-TestMinimumBasicScenario-1545604579-project Jun 20 18:53:48.231131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:53:48.231131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:53:48.231131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: b98488d018b04b34a6758f8b55925316 Jun 20 18:53:48.231131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-TestMinimumBasicScenario-1545604579-project Jun 20 18:53:48.231131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:53:48.231131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 could not be found. Jun 20 18:53:48.231131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': 'b1a42434-2efd-4f8e-b3fb-e77f0e99f072'} Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 could not be found. Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:53:48.232138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 could not be found. Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 could not be found. Jun 20 18:53:48.234838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:53:48.236854 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-8c5f7276-968d-46c6-b0a4-7ad06ba69c83 req-e8cc3400-1929-4fa6-9bdc-53f8aa21e610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2614c08f-0c19-4066-8c87-551d4ac2f725", "name": "network-vif-deleted", "tag": "ffa2211c-05a6-4fea-b138-2d18f0a69e0b"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:48.237799 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fb633ab1-8f75-4a17-a365-3ecdeb5a67ca tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Returning 404 to user: Instance b1a42434-2efd-4f8e-b3fb-e77f0e99f072 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:53:48.238655 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fb633ab1-8f75-4a17-a365-3ecdeb5a67ca tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072" status: 404 len: 111 microversion: 2.1 time: 0.042929 Jun 20 18:53:48.239430 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 444/875] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:48 2022] GET /compute/v2.1/servers/b1a42434-2efd-4f8e-b3fb-e77f0e99f072 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:53:48.243993 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-8c5f7276-968d-46c6-b0a4-7ad06ba69c83 req-e8cc3400-1929-4fa6-9bdc-53f8aa21e610 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:48.244643 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-8c5f7276-968d-46c6-b0a4-7ad06ba69c83 req-e8cc3400-1929-4fa6-9bdc-53f8aa21e610 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:48.247729 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-39a4bb2e-66eb-40b2-a4da-f74a39ce3403 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] Calling method '.version_select at 0x7f7e448285e0>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:48.257388 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-8c5f7276-968d-46c6-b0a4-7ad06ba69c83 req-e8cc3400-1929-4fa6-9bdc-53f8aa21e610 service nova] Creating event network-vif-deleted:ffa2211c-05a6-4fea-b138-2d18f0a69e0b for instance 2614c08f-0c19-4066-8c87-551d4ac2f725 on hv-cinder-83697 Jun 20 18:53:48.262285 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-8c5f7276-968d-46c6-b0a4-7ad06ba69c83 req-e8cc3400-1929-4fa6-9bdc-53f8aa21e610 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035882 Jun 20 18:53:48.263290 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 432/876] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:53:48.278402 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-39a4bb2e-66eb-40b2-a4da-f74a39ce3403 tempest-TestMinimumBasicScenario-1545604579 tempest-TestMinimumBasicScenario-1545604579-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-519464206" status: 202 len: 0 microversion: 2.1 time: 0.034319 Jun 20 18:53:48.279809 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 445/877] 10.222.0.43 () {58 vars in 1268 bytes} [Mon Jun 20 18:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-519464206 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 18:53:49.153549 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-053be71a-1b1f-424e-8706-26548146bb04 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:49.154425 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-053be71a-1b1f-424e-8706-26548146bb04 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:49.161255 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-053be71a-1b1f-424e-8706-26548146bb04 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:49.162022 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-053be71a-1b1f-424e-8706-26548146bb04 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:49.164053 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-053be71a-1b1f-424e-8706-26548146bb04 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:49.164721 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-053be71a-1b1f-424e-8706-26548146bb04 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:49.178909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-053be71a-1b1f-424e-8706-26548146bb04 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] HTTP exception thrown: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-053be71a-1b1f-424e-8706-26548146bb04 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Request method failure captured: Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 HTTP/1.1 Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMByfBN7Azj5ezBS-4LHeZitSTwRsW6M-U9cDLTjOzRO_mZ-F6TlZluQNdBIbLndGNDG7AR8HXGA_w-uK_xFYQmlhUuWqJ4ow5s3D12SO198AC9obL7HI19lFh67b-OaPUMFtrMo4Pb-kYSd8VK-1yo-jQlpsxxpYCOStIKU6_AMBEQ Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: e724578c7aab45bb8ae2317c33e3be33 Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:53:49.181736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:53:49.183225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e724578c7aab45bb8ae2317c33e3be33", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e724578c7aab45bb8ae2317c33e3be33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e724578c7aab45bb8ae2317c33e3be33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e724578c7aab45bb8ae2317c33e3be33"}]}] Jun 20 18:53:49.183225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:53:49.183225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: e724578c7aab45bb8ae2317c33e3be33 Jun 20 18:53:49.183225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:53:49.183225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-AttachVolumeTestJSON-457969774-project Jun 20 18:53:49.183225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:53:49.183225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:53:49.183225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 016cfd43630b42f38efcd37ea9a66a10 Jun 20 18:53:49.183225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-AttachVolumeTestJSON-457969774-project Jun 20 18:53:49.183225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:53:49.183225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:53:49.183225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': '2614c08f-0c19-4066-8c87-551d4ac2f725'} Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:53:49.183995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:53:49.185193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:53:49.186252 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-053be71a-1b1f-424e-8706-26548146bb04 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Returning 404 to user: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:53:49.186252 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-053be71a-1b1f-424e-8706-26548146bb04 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 404 len: 111 microversion: 2.1 time: 0.036584 Jun 20 18:53:49.186514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 433/878] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:49 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:53:49.191519 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ee08e415-11b5-488e-8b59-74121808a5e7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '.version_select at 0x7f7e4483e940>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:49.209492 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ee08e415-11b5-488e-8b59-74121808a5e7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-415244161" status: 202 len: 0 microversion: 2.1 time: 0.021706 Jun 20 18:53:49.211153 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 446/879] 10.222.0.43 () {58 vars in 1217 bytes} [Mon Jun 20 18:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-415244161 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:53:49.816393 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2b8ec51c-7e88-41a4-b314-43d155926617 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Action: 'create', calling method: .version_select at 0x7f7e490c48b0>, body: {"keypair": {"name": "tempest-keypair-1185164739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOtuXadu1FxB7rObVxeaXSeQmJyCQo9XcS3u0eq8hWivLRnl1VUg5Mh4X9+dKvekrLSJuTH7b8oa2jNTOTj7rR800mcmV6QaroTHZFp5/wkLl1znAIxRF0wb+3kHR7teQ=="}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:49.831749 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-2b8ec51c-7e88-41a4-b314-43d155926617 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Getting quotas for project e724578c7aab45bb8ae2317c33e3be33. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:53:49.837458 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-2b8ec51c-7e88-41a4-b314-43d155926617 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Getting quotas for user 016cfd43630b42f38efcd37ea9a66a10 and project e724578c7aab45bb8ae2317c33e3be33. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:53:49.863890 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2b8ec51c-7e88-41a4-b314-43d155926617 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051207 Jun 20 18:53:49.864627 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 434/880] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jun 20 18:53:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:53:52.155458 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1453735677", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1789880-f2ae-400c-beb2-23e8cf0eb58d"}], "security_groups": [{"name": "tempest-securitygroup--104507299"}], "key_name": "tempest-keypair-1185164739", "user_data": "}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:52.337626 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.network.neutron [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] validate_networks() for [('c1789880-f2ae-400c-beb2-23e8cf0eb58d', None, None, None, None, None)] {{(pid=124189) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:53:52.872661 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Flavor limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:53:52.873241 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Image limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:53:52.873929 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Flavor pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:53:52.874345 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Image pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:53:52.874758 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:53:52.884277 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:52.884734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:52.885569 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:52.886187 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:52.904876 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Getting quotas for project e724578c7aab45bb8ae2317c33e3be33. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:53:52.908876 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Getting quotas for user 016cfd43630b42f38efcd37ea9a66a10 and project e724578c7aab45bb8ae2317c33e3be33. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:53:52.920906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Going to run 1 instances... {{(pid=124189) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:53:52.923220 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124189) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:53:52.980654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0f6dc0c8-a91f-4618-8699-8cce677ceba5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.829413 Jun 20 18:53:52.981616 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 447/881] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:53:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:53:52.991232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-68d76967-daca-401a-9415-79f3f487efe7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:52.992420 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-68d76967-daca-401a-9415-79f3f487efe7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:53.080205 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-68d76967-daca-401a-9415-79f3f487efe7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:53.091295 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-68d76967-daca-401a-9415-79f3f487efe7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1238 microversion: 2.1 time: 0.103625 Jun 20 18:53:53.101116 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 435/882] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:52 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1238 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:54.117829 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4708349c-6a75-43fd-8f59-6eba0b989a27 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:54.119296 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-4708349c-6a75-43fd-8f59-6eba0b989a27 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:54.128649 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4708349c-6a75-43fd-8f59-6eba0b989a27 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:54.129318 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4708349c-6a75-43fd-8f59-6eba0b989a27 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:54.130541 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4708349c-6a75-43fd-8f59-6eba0b989a27 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:54.131256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4708349c-6a75-43fd-8f59-6eba0b989a27 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:54.226019 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-4708349c-6a75-43fd-8f59-6eba0b989a27 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:54.237378 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4708349c-6a75-43fd-8f59-6eba0b989a27 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1298 microversion: 2.1 time: 0.124144 Jun 20 18:53:54.239348 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 448/883] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:54 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1298 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:55.255440 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-395e71b6-93af-4488-9ecf-52b170f78d5d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:55.256062 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-395e71b6-93af-4488-9ecf-52b170f78d5d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:55.263371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-395e71b6-93af-4488-9ecf-52b170f78d5d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:55.264094 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-395e71b6-93af-4488-9ecf-52b170f78d5d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:55.265068 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-395e71b6-93af-4488-9ecf-52b170f78d5d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:55.265728 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-395e71b6-93af-4488-9ecf-52b170f78d5d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:55.476612 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-395e71b6-93af-4488-9ecf-52b170f78d5d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:55.485338 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-395e71b6-93af-4488-9ecf-52b170f78d5d tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1363 microversion: 2.1 time: 0.234310 Jun 20 18:53:55.486487 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 436/884] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:55 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:55.845005 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-53040371-3ca1-4acf-b054-1876579d222c req-bb0a5ad5-4b70-4465-860a-02ee198a97ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9599ed34-1484-4080-9eb5-478b932f55a0", "tag": "0e831b7c-cf98-4e3a-9684-438217582746"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:53:55.861922 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-53040371-3ca1-4acf-b054-1876579d222c req-bb0a5ad5-4b70-4465-860a-02ee198a97ed service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:55.862726 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-53040371-3ca1-4acf-b054-1876579d222c req-bb0a5ad5-4b70-4465-860a-02ee198a97ed service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:55.877610 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-53040371-3ca1-4acf-b054-1876579d222c req-bb0a5ad5-4b70-4465-860a-02ee198a97ed service nova] Creating event network-changed:0e831b7c-cf98-4e3a-9684-438217582746 for instance 9599ed34-1484-4080-9eb5-478b932f55a0 on hv-cinder-83697 Jun 20 18:53:55.882905 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-53040371-3ca1-4acf-b054-1876579d222c req-bb0a5ad5-4b70-4465-860a-02ee198a97ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041914 Jun 20 18:53:55.884177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 449/885] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:53:56.503136 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8d690e4b-ff7c-4d3d-a7ba-6b7096e10e7e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:56.503681 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8d690e4b-ff7c-4d3d-a7ba-6b7096e10e7e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:56.514386 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8d690e4b-ff7c-4d3d-a7ba-6b7096e10e7e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:56.515082 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8d690e4b-ff7c-4d3d-a7ba-6b7096e10e7e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:56.516076 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8d690e4b-ff7c-4d3d-a7ba-6b7096e10e7e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:56.516684 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8d690e4b-ff7c-4d3d-a7ba-6b7096e10e7e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:56.858389 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8d690e4b-ff7c-4d3d-a7ba-6b7096e10e7e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:56.870932 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8d690e4b-ff7c-4d3d-a7ba-6b7096e10e7e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1363 microversion: 2.1 time: 0.371652 Jun 20 18:53:56.879374 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 437/886] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:56 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:57.889596 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-746b9012-6ee2-400b-a7ae-da97736156e6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:57.890294 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-746b9012-6ee2-400b-a7ae-da97736156e6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:57.897699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-746b9012-6ee2-400b-a7ae-da97736156e6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:57.898150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-746b9012-6ee2-400b-a7ae-da97736156e6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:57.899273 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-746b9012-6ee2-400b-a7ae-da97736156e6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:57.899709 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-746b9012-6ee2-400b-a7ae-da97736156e6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:58.036975 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-746b9012-6ee2-400b-a7ae-da97736156e6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:58.045099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-746b9012-6ee2-400b-a7ae-da97736156e6 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1363 microversion: 2.1 time: 0.160368 Jun 20 18:53:58.045653 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 450/887] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:57 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:53:59.062402 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-531cde47-b388-43e8-a2a6-90717dcdda93 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:53:59.063038 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-531cde47-b388-43e8-a2a6-90717dcdda93 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:53:59.070173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-531cde47-b388-43e8-a2a6-90717dcdda93 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:59.070624 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-531cde47-b388-43e8-a2a6-90717dcdda93 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:59.071413 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-531cde47-b388-43e8-a2a6-90717dcdda93 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:53:59.071852 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-531cde47-b388-43e8-a2a6-90717dcdda93 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:53:59.203539 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-531cde47-b388-43e8-a2a6-90717dcdda93 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:53:59.210890 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-531cde47-b388-43e8-a2a6-90717dcdda93 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1363 microversion: 2.1 time: 0.152316 Jun 20 18:53:59.211469 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 438/888] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:53:59 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:00.227671 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-30796473-5289-4e09-86a9-31bab71b376b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:00.228281 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-30796473-5289-4e09-86a9-31bab71b376b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:00.235083 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-30796473-5289-4e09-86a9-31bab71b376b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:00.235534 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-30796473-5289-4e09-86a9-31bab71b376b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:00.236302 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-30796473-5289-4e09-86a9-31bab71b376b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:00.236738 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-30796473-5289-4e09-86a9-31bab71b376b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:00.366323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-30796473-5289-4e09-86a9-31bab71b376b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:00.379080 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-30796473-5289-4e09-86a9-31bab71b376b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1363 microversion: 2.1 time: 0.155177 Jun 20 18:54:00.379651 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 451/889] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:00 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:01.395859 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6264fda5-d703-49c2-9d37-54586966c27b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:01.396365 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6264fda5-d703-49c2-9d37-54586966c27b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:01.403391 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6264fda5-d703-49c2-9d37-54586966c27b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:01.403837 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6264fda5-d703-49c2-9d37-54586966c27b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:01.404595 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6264fda5-d703-49c2-9d37-54586966c27b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:01.405029 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6264fda5-d703-49c2-9d37-54586966c27b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:01.533045 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6264fda5-d703-49c2-9d37-54586966c27b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:01.540876 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6264fda5-d703-49c2-9d37-54586966c27b tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1363 microversion: 2.1 time: 0.148964 Jun 20 18:54:01.541437 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 439/890] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:01 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:02.557808 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-288d1f94-24b5-442c-8940-a5030ee9c43f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:02.558419 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-288d1f94-24b5-442c-8940-a5030ee9c43f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:02.564922 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-288d1f94-24b5-442c-8940-a5030ee9c43f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:02.565370 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-288d1f94-24b5-442c-8940-a5030ee9c43f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:02.566123 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-288d1f94-24b5-442c-8940-a5030ee9c43f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:02.566556 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-288d1f94-24b5-442c-8940-a5030ee9c43f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:02.691011 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-288d1f94-24b5-442c-8940-a5030ee9c43f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:02.698384 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-288d1f94-24b5-442c-8940-a5030ee9c43f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1363 microversion: 2.1 time: 0.145050 Jun 20 18:54:02.699596 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 452/891] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:02 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:03.072995 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-f339968c-ddd0-4df2-982d-57974dff345a req-cd8c2c4c-d5fd-4c7e-8824-5e939ca145df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9599ed34-1484-4080-9eb5-478b932f55a0", "name": "network-vif-plugged", "status": "completed", "tag": "0e831b7c-cf98-4e3a-9684-438217582746"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:54:03.082245 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-f339968c-ddd0-4df2-982d-57974dff345a req-cd8c2c4c-d5fd-4c7e-8824-5e939ca145df service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:03.082704 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-f339968c-ddd0-4df2-982d-57974dff345a req-cd8c2c4c-d5fd-4c7e-8824-5e939ca145df service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:03.086941 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=6 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:03.096023 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-f339968c-ddd0-4df2-982d-57974dff345a req-cd8c2c4c-d5fd-4c7e-8824-5e939ca145df service nova] Creating event network-vif-plugged:0e831b7c-cf98-4e3a-9684-438217582746 for instance 9599ed34-1484-4080-9eb5-478b932f55a0 on hv-cinder-83697 Jun 20 18:54:03.102022 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-f339968c-ddd0-4df2-982d-57974dff345a req-cd8c2c4c-d5fd-4c7e-8824-5e939ca145df service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032675 Jun 20 18:54:03.102620 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 440/892] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:54:03.715670 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1c3f25b1-5086-48c9-9e90-f7011163c61c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:03.716209 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1c3f25b1-5086-48c9-9e90-f7011163c61c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:03.718113 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:03.718954 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=6 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:03.725794 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1c3f25b1-5086-48c9-9e90-f7011163c61c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:03.726242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1c3f25b1-5086-48c9-9e90-f7011163c61c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:03.727028 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1c3f25b1-5086-48c9-9e90-f7011163c61c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:03.727483 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1c3f25b1-5086-48c9-9e90-f7011163c61c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:03.854876 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1c3f25b1-5086-48c9-9e90-f7011163c61c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:03.862176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1c3f25b1-5086-48c9-9e90-f7011163c61c tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1363 microversion: 2.1 time: 0.150504 Jun 20 18:54:03.862739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 453/893] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:03 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:04.880566 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c6ab2289-8f6b-4a11-8e9d-23316f7134b3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:04.881299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c6ab2289-8f6b-4a11-8e9d-23316f7134b3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:04.888031 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c6ab2289-8f6b-4a11-8e9d-23316f7134b3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:04.888470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c6ab2289-8f6b-4a11-8e9d-23316f7134b3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:04.889212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c6ab2289-8f6b-4a11-8e9d-23316f7134b3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:04.889639 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c6ab2289-8f6b-4a11-8e9d-23316f7134b3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:05.016518 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c6ab2289-8f6b-4a11-8e9d-23316f7134b3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:05.024569 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c6ab2289-8f6b-4a11-8e9d-23316f7134b3 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1363 microversion: 2.1 time: 0.148422 Jun 20 18:54:05.025428 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 441/894] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:04 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:06.043401 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-193f7faf-b13b-4a74-ae71-6659e0895a0f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:06.044003 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-193f7faf-b13b-4a74-ae71-6659e0895a0f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:06.046307 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:06.051942 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-193f7faf-b13b-4a74-ae71-6659e0895a0f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:06.052383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-193f7faf-b13b-4a74-ae71-6659e0895a0f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:06.053166 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-193f7faf-b13b-4a74-ae71-6659e0895a0f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:06.053597 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-193f7faf-b13b-4a74-ae71-6659e0895a0f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:06.182148 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-193f7faf-b13b-4a74-ae71-6659e0895a0f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:06.185546 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:06.190256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-193f7faf-b13b-4a74-ae71-6659e0895a0f tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1549 microversion: 2.1 time: 0.150782 Jun 20 18:54:06.190809 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 454/895] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:06 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:54:06.206597 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-14e4e04d-b7d8-49d7-9913-f3a3c4a88bc2 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:06.207121 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-14e4e04d-b7d8-49d7-9913-f3a3c4a88bc2 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:06.214202 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-14e4e04d-b7d8-49d7-9913-f3a3c4a88bc2 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:06.214646 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-14e4e04d-b7d8-49d7-9913-f3a3c4a88bc2 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:06.215423 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-14e4e04d-b7d8-49d7-9913-f3a3c4a88bc2 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:06.215850 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-14e4e04d-b7d8-49d7-9913-f3a3c4a88bc2 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:06.289680 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-14e4e04d-b7d8-49d7-9913-f3a3c4a88bc2 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086803 Jun 20 18:54:06.290264 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 442/896] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jun 20 18:54:06 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:54:07.190312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-e17ca1b1-e405-4bd1-8639-3ec261e4e61c req-7c4c4a9e-175f-4434-88bd-26a4d311d82a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9599ed34-1484-4080-9eb5-478b932f55a0", "tag": "0e831b7c-cf98-4e3a-9684-438217582746"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:54:07.200372 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-e17ca1b1-e405-4bd1-8639-3ec261e4e61c req-7c4c4a9e-175f-4434-88bd-26a4d311d82a service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:07.200816 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-e17ca1b1-e405-4bd1-8639-3ec261e4e61c req-7c4c4a9e-175f-4434-88bd-26a4d311d82a service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:07.212628 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-e17ca1b1-e405-4bd1-8639-3ec261e4e61c req-7c4c4a9e-175f-4434-88bd-26a4d311d82a service nova] Creating event network-changed:0e831b7c-cf98-4e3a-9684-438217582746 for instance 9599ed34-1484-4080-9eb5-478b932f55a0 on hv-cinder-83697 Jun 20 18:54:07.217608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-e17ca1b1-e405-4bd1-8639-3ec261e4e61c req-7c4c4a9e-175f-4434-88bd-26a4d311d82a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030858 Jun 20 18:54:07.218359 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 455/897] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:54:31.881196 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:31.881963 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=46 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:31.885925 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b9d9b3d6-b5fd-4125-b125-767012210912 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:31.886413 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b9d9b3d6-b5fd-4125-b125-767012210912 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:31.893340 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b9d9b3d6-b5fd-4125-b125-767012210912 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:31.893784 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b9d9b3d6-b5fd-4125-b125-767012210912 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:31.894539 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b9d9b3d6-b5fd-4125-b125-767012210912 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:31.894998 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b9d9b3d6-b5fd-4125-b125-767012210912 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:31.972852 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-b9d9b3d6-b5fd-4125-b125-767012210912 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lazy-loading 'services' on Instance uuid f7fdf69c-2b2a-4801-82ca-54805176159b {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:54:32.041862 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b9d9b3d6-b5fd-4125-b125-767012210912 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-volume_attachments/1da1cc46-7bd5-493f-b9c1-10b923921701" status: 202 len: 0 microversion: 2.1 time: 0.162665 Jun 20 18:54:32.042468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 443/898] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jun 20 18:54:31 2022] DELETE /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-volume_attachments/1da1cc46-7bd5-493f-b9c1-10b923921701 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:54:32.048896 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=3 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:32.049664 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:32.054609 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-227e5bd8-bfd6-41d9-bd1d-8127a5b35e47 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:32.055633 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-227e5bd8-bfd6-41d9-bd1d-8127a5b35e47 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:32.062997 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-227e5bd8-bfd6-41d9-bd1d-8127a5b35e47 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:32.063442 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-227e5bd8-bfd6-41d9-bd1d-8127a5b35e47 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:32.064203 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-227e5bd8-bfd6-41d9-bd1d-8127a5b35e47 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:32.064631 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-227e5bd8-bfd6-41d9-bd1d-8127a5b35e47 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:32.093520 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-227e5bd8-bfd6-41d9-bd1d-8127a5b35e47 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046241 Jun 20 18:54:32.093983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 456/899] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:54:32 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:54:33.106466 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0cdc1bea-5543-427b-8465-9f1226cf3663 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:33.107557 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0cdc1bea-5543-427b-8465-9f1226cf3663 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:33.114129 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0cdc1bea-5543-427b-8465-9f1226cf3663 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:33.114546 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0cdc1bea-5543-427b-8465-9f1226cf3663 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:33.115974 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0cdc1bea-5543-427b-8465-9f1226cf3663 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:33.116413 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0cdc1bea-5543-427b-8465-9f1226cf3663 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:33.144354 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0cdc1bea-5543-427b-8465-9f1226cf3663 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042690 Jun 20 18:54:33.144899 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 444/900] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:54:33 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 18:54:33.219642 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0c199333-df4d-4f24-9adc-70639976e53d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:33.220171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0c199333-df4d-4f24-9adc-70639976e53d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:33.227161 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0c199333-df4d-4f24-9adc-70639976e53d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:33.227713 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0c199333-df4d-4f24-9adc-70639976e53d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:33.228468 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0c199333-df4d-4f24-9adc-70639976e53d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:33.228897 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0c199333-df4d-4f24-9adc-70639976e53d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:33.253461 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0c199333-df4d-4f24-9adc-70639976e53d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Going to try to terminate instance {{(pid=124189) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:54:33.329169 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0c199333-df4d-4f24-9adc-70639976e53d tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 204 len: 0 microversion: 2.1 time: 0.112923 Jun 20 18:54:33.329842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 457/901] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:54:33 2022] DELETE /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:54:33.338605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-447a9ff8-cf28-410f-a354-bac5fa558a83 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:33.339233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-447a9ff8-cf28-410f-a354-bac5fa558a83 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:33.345164 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-447a9ff8-cf28-410f-a354-bac5fa558a83 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:33.345644 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-447a9ff8-cf28-410f-a354-bac5fa558a83 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:33.346391 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-447a9ff8-cf28-410f-a354-bac5fa558a83 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:33.346820 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-447a9ff8-cf28-410f-a354-bac5fa558a83 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:33.477844 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-447a9ff8-cf28-410f-a354-bac5fa558a83 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:33.485229 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-447a9ff8-cf28-410f-a354-bac5fa558a83 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1689 microversion: 2.1 time: 0.150449 Jun 20 18:54:33.485781 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 445/902] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:33 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:54:34.502693 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-91c98d74-d0c7-4581-bbc9-c4c0c0df94cd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:34.503410 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-91c98d74-d0c7-4581-bbc9-c4c0c0df94cd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:34.510339 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91c98d74-d0c7-4581-bbc9-c4c0c0df94cd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:34.510792 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91c98d74-d0c7-4581-bbc9-c4c0c0df94cd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:34.511583 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91c98d74-d0c7-4581-bbc9-c4c0c0df94cd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:34.512022 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91c98d74-d0c7-4581-bbc9-c4c0c0df94cd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:34.641802 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-91c98d74-d0c7-4581-bbc9-c4c0c0df94cd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:34.650019 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-91c98d74-d0c7-4581-bbc9-c4c0c0df94cd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1689 microversion: 2.1 time: 0.151531 Jun 20 18:54:34.650593 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 458/903] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:34 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:35.667080 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-697759d3-7c86-4345-80dc-c48dea4b161f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:35.667689 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-697759d3-7c86-4345-80dc-c48dea4b161f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:35.674095 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-697759d3-7c86-4345-80dc-c48dea4b161f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:35.674540 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-697759d3-7c86-4345-80dc-c48dea4b161f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:35.675327 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-697759d3-7c86-4345-80dc-c48dea4b161f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:35.675766 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-697759d3-7c86-4345-80dc-c48dea4b161f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:35.803909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-697759d3-7c86-4345-80dc-c48dea4b161f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:35.811246 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-697759d3-7c86-4345-80dc-c48dea4b161f tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1689 microversion: 2.1 time: 0.148329 Jun 20 18:54:35.811804 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 446/904] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:35 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:36.828656 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8df5f813-2fc4-42aa-b0af-3dfe6d88686b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:36.829292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8df5f813-2fc4-42aa-b0af-3dfe6d88686b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:36.836431 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8df5f813-2fc4-42aa-b0af-3dfe6d88686b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:36.836871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8df5f813-2fc4-42aa-b0af-3dfe6d88686b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:36.837626 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8df5f813-2fc4-42aa-b0af-3dfe6d88686b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:36.838069 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8df5f813-2fc4-42aa-b0af-3dfe6d88686b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:36.962131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8df5f813-2fc4-42aa-b0af-3dfe6d88686b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:36.969589 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8df5f813-2fc4-42aa-b0af-3dfe6d88686b tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1689 microversion: 2.1 time: 0.144778 Jun 20 18:54:36.970088 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 459/905] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:36 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1689 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:37.985718 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6d705599-b9cd-4492-ad97-3f05980a1f60 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:37.986401 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6d705599-b9cd-4492-ad97-3f05980a1f60 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:37.993510 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6d705599-b9cd-4492-ad97-3f05980a1f60 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:37.994053 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6d705599-b9cd-4492-ad97-3f05980a1f60 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:37.994890 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6d705599-b9cd-4492-ad97-3f05980a1f60 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:37.995477 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6d705599-b9cd-4492-ad97-3f05980a1f60 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:38.057512 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6d705599-b9cd-4492-ad97-3f05980a1f60 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:38.064884 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6d705599-b9cd-4492-ad97-3f05980a1f60 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 200 len: 1622 microversion: 2.1 time: 0.083175 Jun 20 18:54:38.065443 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 447/906] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:37 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 1622 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:38.234954 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-f2bc8121-0869-4677-9655-2618ac36e8bb req-11ee51eb-2c5b-4d2a-bb37-c6b75674467a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7fdf69c-2b2a-4801-82ca-54805176159b", "name": "network-vif-deleted", "tag": "cbfc3863-3fe2-440b-acc3-803dbc08a337"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:54:38.245197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-f2bc8121-0869-4677-9655-2618ac36e8bb req-11ee51eb-2c5b-4d2a-bb37-c6b75674467a service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:38.246261 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-f2bc8121-0869-4677-9655-2618ac36e8bb req-11ee51eb-2c5b-4d2a-bb37-c6b75674467a service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:38.259284 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-f2bc8121-0869-4677-9655-2618ac36e8bb req-11ee51eb-2c5b-4d2a-bb37-c6b75674467a service nova] Creating event network-vif-deleted:cbfc3863-3fe2-440b-acc3-803dbc08a337 for instance f7fdf69c-2b2a-4801-82ca-54805176159b on hv-cinder-83697 Jun 20 18:54:38.264817 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-f2bc8121-0869-4677-9655-2618ac36e8bb req-11ee51eb-2c5b-4d2a-bb37-c6b75674467a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033634 Jun 20 18:54:38.265780 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 460/907] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:54:39.081476 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-02f7e077-237c-450e-b19a-797e1b9e7c34 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:39.082078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-02f7e077-237c-450e-b19a-797e1b9e7c34 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: f7fdf69c-2b2a-4801-82ca-54805176159b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:39.088564 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-02f7e077-237c-450e-b19a-797e1b9e7c34 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:39.089010 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-02f7e077-237c-450e-b19a-797e1b9e7c34 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:39.089759 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-02f7e077-237c-450e-b19a-797e1b9e7c34 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:39.090188 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-02f7e077-237c-450e-b19a-797e1b9e7c34 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:39.104205 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-02f7e077-237c-450e-b19a-797e1b9e7c34 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] HTTP exception thrown: Instance f7fdf69c-2b2a-4801-82ca-54805176159b could not be found. Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-02f7e077-237c-450e-b19a-797e1b9e7c34 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Request method failure captured: Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b HTTP/1.1 Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMDgxGdD9NplnDOb9Kvkoi9z6IaPdYfKFk15cOFtxIEbZ3iM6js25CXsTI1b08r7rptp84JQv3s-L6cP6ceMNZuMSW6JZB2WSkrDda2t9Z9oJjBhawuAgtsiksYxhkCbb4o9vew5lG6pfzbGiHzTykEBsXAeqFgzCV--SlTvu97eD9o Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 7b4a919be31b4c74a3197d98ecec7fde Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:54:39.105848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:54:39.107561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b4a919be31b4c74a3197d98ecec7fde", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b4a919be31b4c74a3197d98ecec7fde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b4a919be31b4c74a3197d98ecec7fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b4a919be31b4c74a3197d98ecec7fde"}]}] Jun 20 18:54:39.107561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:54:39.107561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 7b4a919be31b4c74a3197d98ecec7fde Jun 20 18:54:39.107561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:54:39.107561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-ServerRescueNegativeTestJSON-905734882-project Jun 20 18:54:39.107561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:54:39.107561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:54:39.107561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 31fed190cac24d1b8326425f737e220b Jun 20 18:54:39.107561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-ServerRescueNegativeTestJSON-905734882-project Jun 20 18:54:39.107561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:54:39.107561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance f7fdf69c-2b2a-4801-82ca-54805176159b could not be found. Jun 20 18:54:39.107561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': 'f7fdf69c-2b2a-4801-82ca-54805176159b'} Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7fdf69c-2b2a-4801-82ca-54805176159b could not be found. Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:54:39.108580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7fdf69c-2b2a-4801-82ca-54805176159b could not be found. Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7fdf69c-2b2a-4801-82ca-54805176159b could not be found. Jun 20 18:54:39.109909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:39.111431 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-02f7e077-237c-450e-b19a-797e1b9e7c34 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Returning 404 to user: Instance f7fdf69c-2b2a-4801-82ca-54805176159b could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:54:39.111431 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-02f7e077-237c-450e-b19a-797e1b9e7c34 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b" status: 404 len: 111 microversion: 2.1 time: 0.029617 Jun 20 18:54:39.111431 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 448/908] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:39 2022] GET /compute/v2.1/servers/f7fdf69c-2b2a-4801-82ca-54805176159b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:54:39.117448 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-204811bb-b0b4-4cfc-97b0-d9e7e85f15d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '.version_select at 0x7f7e4483e550>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:39.134725 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-204811bb-b0b4-4cfc-97b0-d9e7e85f15d0 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-986286275" status: 202 len: 0 microversion: 2.1 time: 0.022074 Jun 20 18:54:39.135297 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 461/909] 10.222.0.43 () {58 vars in 1217 bytes} [Mon Jun 20 18:54:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-986286275 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:54:39.640752 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-01306f6d-da65-4fd3-8022-436544a5e870 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:39.641143 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-01306f6d-da65-4fd3-8022-436544a5e870 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:39.647708 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-01306f6d-da65-4fd3-8022-436544a5e870 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:39.648151 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-01306f6d-da65-4fd3-8022-436544a5e870 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:39.648909 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-01306f6d-da65-4fd3-8022-436544a5e870 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:39.649366 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-01306f6d-da65-4fd3-8022-436544a5e870 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:39.674031 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-01306f6d-da65-4fd3-8022-436544a5e870 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/ips" status: 200 len: 150 microversion: 2.1 time: 0.037664 Jun 20 18:54:39.675051 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 449/910] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jun 20 18:54:39 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:54:40.992518 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-929d3527-257a-40ef-ac19-e183e7e40895 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a29334bd-8a46-401f-83bc-fa313efdf892"}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:54:40.993670 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-929d3527-257a-40ef-ac19-e183e7e40895 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:41.000137 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-929d3527-257a-40ef-ac19-e183e7e40895 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:41.000572 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-929d3527-257a-40ef-ac19-e183e7e40895 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:41.001319 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-929d3527-257a-40ef-ac19-e183e7e40895 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:41.001748 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-929d3527-257a-40ef-ac19-e183e7e40895 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:41.272237 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-929d3527-257a-40ef-ac19-e183e7e40895 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "POST /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284504 Jun 20 18:54:41.276732 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 462/911] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jun 20 18:54:40 2022] POST /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:54:42.008142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9ed2c1e5-42a4-420e-a332-5d50eff97d07 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:42.008636 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9ed2c1e5-42a4-420e-a332-5d50eff97d07 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:42.015160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9ed2c1e5-42a4-420e-a332-5d50eff97d07 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:42.015606 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9ed2c1e5-42a4-420e-a332-5d50eff97d07 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:42.016362 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9ed2c1e5-42a4-420e-a332-5d50eff97d07 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:42.016797 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9ed2c1e5-42a4-420e-a332-5d50eff97d07 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:42.041753 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9ed2c1e5-42a4-420e-a332-5d50eff97d07 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:54:42.113560 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9ed2c1e5-42a4-420e-a332-5d50eff97d07 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 204 len: 0 microversion: 2.1 time: 0.109245 Jun 20 18:54:42.114045 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 450/912] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:54:42 2022] DELETE /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:54:42.123242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-046f5600-6e48-4384-98c8-b1d8cb9cc2c1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:42.123940 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-046f5600-6e48-4384-98c8-b1d8cb9cc2c1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:42.131405 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-046f5600-6e48-4384-98c8-b1d8cb9cc2c1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:42.131853 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-046f5600-6e48-4384-98c8-b1d8cb9cc2c1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:42.132734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-046f5600-6e48-4384-98c8-b1d8cb9cc2c1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:42.133177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-046f5600-6e48-4384-98c8-b1d8cb9cc2c1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:42.258975 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-046f5600-6e48-4384-98c8-b1d8cb9cc2c1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:42.266366 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-046f5600-6e48-4384-98c8-b1d8cb9cc2c1 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1507 microversion: 2.1 time: 0.147805 Jun 20 18:54:42.266956 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 463/913] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:42 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:43.283897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5bc61ab1-2cc9-4e03-b68e-e274fc3a9cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:43.284521 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5bc61ab1-2cc9-4e03-b68e-e274fc3a9cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:43.291849 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5bc61ab1-2cc9-4e03-b68e-e274fc3a9cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:43.292292 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5bc61ab1-2cc9-4e03-b68e-e274fc3a9cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:43.293065 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5bc61ab1-2cc9-4e03-b68e-e274fc3a9cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:43.293505 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5bc61ab1-2cc9-4e03-b68e-e274fc3a9cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:43.358884 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-b1bbb225-b367-4e34-a880-cbe4121c80f4 req-7d539781-d744-46e2-bdd9-87e2944533f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d", "name": "network-vif-deleted", "tag": "1f9e0457-eeee-4812-84ac-eeb566b3e205"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:54:43.369322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-b1bbb225-b367-4e34-a880-cbe4121c80f4 req-7d539781-d744-46e2-bdd9-87e2944533f7 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:43.369470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5bc61ab1-2cc9-4e03-b68e-e274fc3a9cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:43.369769 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-b1bbb225-b367-4e34-a880-cbe4121c80f4 req-7d539781-d744-46e2-bdd9-87e2944533f7 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:43.378168 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5bc61ab1-2cc9-4e03-b68e-e274fc3a9cd8 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 200 len: 1465 microversion: 2.1 time: 0.098484 Jun 20 18:54:43.379092 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 451/914] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:43 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 1465 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:43.392299 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-b1bbb225-b367-4e34-a880-cbe4121c80f4 req-7d539781-d744-46e2-bdd9-87e2944533f7 service nova] Creating event network-vif-deleted:1f9e0457-eeee-4812-84ac-eeb566b3e205 for instance 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d on hv-cinder-83697 Jun 20 18:54:43.398356 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-b1bbb225-b367-4e34-a880-cbe4121c80f4 req-7d539781-d744-46e2-bdd9-87e2944533f7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043790 Jun 20 18:54:43.398972 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 464/915] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:54:44.397272 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c88afd97-6f18-4dc5-89af-2eeaedd32078 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:44.397859 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c88afd97-6f18-4dc5-89af-2eeaedd32078 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:44.404345 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c88afd97-6f18-4dc5-89af-2eeaedd32078 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:44.404792 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c88afd97-6f18-4dc5-89af-2eeaedd32078 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:44.405547 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c88afd97-6f18-4dc5-89af-2eeaedd32078 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:44.405983 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c88afd97-6f18-4dc5-89af-2eeaedd32078 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:44.419376 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-c88afd97-6f18-4dc5-89af-2eeaedd32078 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] HTTP exception thrown: Instance 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d could not be found. Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c88afd97-6f18-4dc5-89af-2eeaedd32078 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Request method failure captured: Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d HTTP/1.1 Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMDgxGdD9NplnDOb9Kvkoi9z6IaPdYfKFk15cOFtxIEbZ3iM6js25CXsTI1b08r7rptp84JQv3s-L6cP6ceMNZuMSW6JZB2WSkrDda2t9Z9oJjBhawuAgtsiksYxhkCbb4o9vew5lG6pfzbGiHzTykEBsXAeqFgzCV--SlTvu97eD9o Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 7b4a919be31b4c74a3197d98ecec7fde Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:54:44.421007 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:54:44.422502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b4a919be31b4c74a3197d98ecec7fde", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b4a919be31b4c74a3197d98ecec7fde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b4a919be31b4c74a3197d98ecec7fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b4a919be31b4c74a3197d98ecec7fde"}]}] Jun 20 18:54:44.422502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:54:44.422502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 7b4a919be31b4c74a3197d98ecec7fde Jun 20 18:54:44.422502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:54:44.422502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-ServerRescueNegativeTestJSON-905734882-project Jun 20 18:54:44.422502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:54:44.422502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:54:44.422502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 31fed190cac24d1b8326425f737e220b Jun 20 18:54:44.422502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-ServerRescueNegativeTestJSON-905734882-project Jun 20 18:54:44.422502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:54:44.422502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d could not be found. Jun 20 18:54:44.422502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': '1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d'} Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d could not be found. Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:54:44.423515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d could not be found. Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d could not be found. Jun 20 18:54:44.424952 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:44.426314 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c88afd97-6f18-4dc5-89af-2eeaedd32078 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Returning 404 to user: Instance 1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:54:44.426314 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c88afd97-6f18-4dc5-89af-2eeaedd32078 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d" status: 404 len: 111 microversion: 2.1 time: 0.029612 Jun 20 18:54:44.426314 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 452/916] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:44 2022] GET /compute/v2.1/servers/1795ccb6-e4c2-4313-a3cd-ad6ae9c7019d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:54:44.431801 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b516ee5e-71af-4dd7-90a6-06d8327152dd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:44.432405 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b516ee5e-71af-4dd7-90a6-06d8327152dd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:44.439221 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b516ee5e-71af-4dd7-90a6-06d8327152dd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:44.439669 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b516ee5e-71af-4dd7-90a6-06d8327152dd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:44.440439 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b516ee5e-71af-4dd7-90a6-06d8327152dd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:44.440867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b516ee5e-71af-4dd7-90a6-06d8327152dd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:44.466757 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b516ee5e-71af-4dd7-90a6-06d8327152dd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Going to try to terminate instance {{(pid=124189) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:54:44.541904 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b516ee5e-71af-4dd7-90a6-06d8327152dd tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 204 len: 0 microversion: 2.1 time: 0.114435 Jun 20 18:54:44.542500 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 465/917] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:54:44 2022] DELETE /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:54:44.550656 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e7b1952c-fcd1-4a7a-9899-b7ad1333f769 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:44.551319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e7b1952c-fcd1-4a7a-9899-b7ad1333f769 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:44.558159 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e7b1952c-fcd1-4a7a-9899-b7ad1333f769 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:44.558702 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e7b1952c-fcd1-4a7a-9899-b7ad1333f769 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:44.560067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e7b1952c-fcd1-4a7a-9899-b7ad1333f769 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:44.560067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e7b1952c-fcd1-4a7a-9899-b7ad1333f769 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:44.691544 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e7b1952c-fcd1-4a7a-9899-b7ad1333f769 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:44.699874 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e7b1952c-fcd1-4a7a-9899-b7ad1333f769 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.153071 Jun 20 18:54:44.700439 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 453/918] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:44 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:54:45.717620 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-699cc397-7253-4a1d-a8a6-f98f554c04ee tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:45.718323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-699cc397-7253-4a1d-a8a6-f98f554c04ee tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:45.727038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-699cc397-7253-4a1d-a8a6-f98f554c04ee tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:45.727485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-699cc397-7253-4a1d-a8a6-f98f554c04ee tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:45.728254 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-699cc397-7253-4a1d-a8a6-f98f554c04ee tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:45.728686 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-699cc397-7253-4a1d-a8a6-f98f554c04ee tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:45.860250 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-699cc397-7253-4a1d-a8a6-f98f554c04ee tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:45.867968 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-699cc397-7253-4a1d-a8a6-f98f554c04ee tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.154691 Jun 20 18:54:45.868538 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 466/919] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:45 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:46.884994 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7c2f7210-533a-41ec-b334-3e2552318c9c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:46.885546 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7c2f7210-533a-41ec-b334-3e2552318c9c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:46.892642 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c2f7210-533a-41ec-b334-3e2552318c9c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:46.893082 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c2f7210-533a-41ec-b334-3e2552318c9c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:46.893832 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c2f7210-533a-41ec-b334-3e2552318c9c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:46.894260 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c2f7210-533a-41ec-b334-3e2552318c9c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:47.023949 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7c2f7210-533a-41ec-b334-3e2552318c9c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:47.031379 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7c2f7210-533a-41ec-b334-3e2552318c9c tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.150302 Jun 20 18:54:47.031936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 454/920] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:46 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:48.049503 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-04889e71-d9ee-4c71-9896-fc2860601a67 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:48.050114 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-04889e71-d9ee-4c71-9896-fc2860601a67 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:48.057300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-04889e71-d9ee-4c71-9896-fc2860601a67 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:48.057742 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-04889e71-d9ee-4c71-9896-fc2860601a67 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:48.058502 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-04889e71-d9ee-4c71-9896-fc2860601a67 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:48.058959 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-04889e71-d9ee-4c71-9896-fc2860601a67 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:48.185299 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-04889e71-d9ee-4c71-9896-fc2860601a67 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fed190cac24d1b8326425f737e220b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4a919be31b4c74a3197d98ecec7fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:48.193708 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-04889e71-d9ee-4c71-9896-fc2860601a67 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 200 len: 1521 microversion: 2.1 time: 0.148081 Jun 20 18:54:48.194626 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 467/921] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:48 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:48.619017 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-77758cba-fdbb-40b5-ab92-31614c607140 req-fc982d82-3a5c-471f-b35e-cf5b4e97a4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a86d158-0870-4597-be67-25d4f9371977", "name": "network-vif-deleted", "tag": "a5d21488-01bf-4805-bcda-afe09b1d3562"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:54:48.627877 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-77758cba-fdbb-40b5-ab92-31614c607140 req-fc982d82-3a5c-471f-b35e-cf5b4e97a4a7 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:48.628321 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-77758cba-fdbb-40b5-ab92-31614c607140 req-fc982d82-3a5c-471f-b35e-cf5b4e97a4a7 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:48.639916 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-77758cba-fdbb-40b5-ab92-31614c607140 req-fc982d82-3a5c-471f-b35e-cf5b4e97a4a7 service nova] Creating event network-vif-deleted:a5d21488-01bf-4805-bcda-afe09b1d3562 for instance 4a86d158-0870-4597-be67-25d4f9371977 on hv-cinder-83697 Jun 20 18:54:48.644864 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-77758cba-fdbb-40b5-ab92-31614c607140 req-fc982d82-3a5c-471f-b35e-cf5b4e97a4a7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029546 Jun 20 18:54:48.645559 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 455/922] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:54:48.740187 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-509bd449-050a-4809-be7b-aaf806262400 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:48.740694 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-509bd449-050a-4809-be7b-aaf806262400 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:48.746939 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-509bd449-050a-4809-be7b-aaf806262400 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:48.747429 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-509bd449-050a-4809-be7b-aaf806262400 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:48.748201 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-509bd449-050a-4809-be7b-aaf806262400 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:48.748639 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-509bd449-050a-4809-be7b-aaf806262400 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:48.775991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-509bd449-050a-4809-be7b-aaf806262400 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf/ips" status: 200 len: 152 microversion: 2.20 time: 0.039716 Jun 20 18:54:48.776562 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 468/923] 10.222.0.43 () {60 vars in 1288 bytes} [Mon Jun 20 18:54:48 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:54:48.790695 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-92656af0-0ced-4a1f-bcee-7d421e880db3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a29334bd-8a46-401f-83bc-fa313efdf892"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:54:48.791875 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-92656af0-0ced-4a1f-bcee-7d421e880db3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:48.798033 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-92656af0-0ced-4a1f-bcee-7d421e880db3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:48.798504 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-92656af0-0ced-4a1f-bcee-7d421e880db3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:48.799309 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-92656af0-0ced-4a1f-bcee-7d421e880db3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:48.799749 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-92656af0-0ced-4a1f-bcee-7d421e880db3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:48.882351 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-92656af0-0ced-4a1f-bcee-7d421e880db3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] HTTP exception thrown: Invalid volume: volume a29334bd-8a46-401f-83bc-fa313efdf892 is already attached to instances: 3d279054-6318-480a-a1d1-2c4a46085141 Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-92656af0-0ced-4a1f-bcee-7d421e880db3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Request method failure captured: Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: POST /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/os-volume_attachments HTTP/1.1 Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 74 Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMB7oKpb5ufs7k91aATNwQ9lBCFsAiscF2D6zDu63Pdu1lDJfudYPQfg-WIoWYQQ-JgV04sOxsJj7QlSIQrKVCkKsbiXYH3d8jdfXZNL0OxCyUpor2PA81B48M0Ll8y0cg4uK3b5-fQlEg3o6bUpvXP-E4SmBiu6KFl4dytZBttHh-M Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:54:48.884798 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:54:48.886258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8006d78bc1604611b3254b5efa451288", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8006d78bc1604611b3254b5efa451288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}] Jun 20 18:54:48.886258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:54:48.886258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:54:48.886258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:54:48.886258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:54:48.886258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:54:48.886258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:54:48.886258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: c3134832f2a647aab761da347f7e9fd4 Jun 20 18:54:48.886258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:54:48.886258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Jun 20 18:54:48.886258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {"volumeAttachment": {"volumeId": "a29334bd-8a46-401f-83bc-fa313efdf892"}} Jun 20 18:54:48.886258 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Invalid volume: volume a29334bd-8a46-401f-83bc-fa313efdf892 is already attached to instances: 3d279054-6318-480a-a1d1-2c4a46085141 Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'server_id': '3d279054-6318-480a-a1d1-2c4a46085141', 'body': {'volumeAttachment': {'volumeId': 'a29334bd-8a46-401f-83bc-fa313efdf892'}}} Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a29334bd-8a46-401f-83bc-fa313efdf892 is already attached to instances: 3d279054-6318-480a-a1d1-2c4a46085141 Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:48.887061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a29334bd-8a46-401f-83bc-fa313efdf892 is already attached to instances: 3d279054-6318-480a-a1d1-2c4a46085141 Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:48.888381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:54:48.889623 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:54:48.889623 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:54:48.889623 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:54:48.889623 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a29334bd-8a46-401f-83bc-fa313efdf892 is already attached to instances: 3d279054-6318-480a-a1d1-2c4a46085141 Jun 20 18:54:48.889623 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:48.889623 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-92656af0-0ced-4a1f-bcee-7d421e880db3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Returning 400 to user: Invalid volume: volume a29334bd-8a46-401f-83bc-fa313efdf892 is already attached to instances: 3d279054-6318-480a-a1d1-2c4a46085141 {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:54:48.889623 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-92656af0-0ced-4a1f-bcee-7d421e880db3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "POST /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101769 Jun 20 18:54:48.891232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 456/924] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jun 20 18:54:48 2022] POST /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 18:54:48.954847 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ac456a0f-77b8-4a98-92a9-40c2646c73a4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:48.955381 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ac456a0f-77b8-4a98-92a9-40c2646c73a4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:48.961738 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ac456a0f-77b8-4a98-92a9-40c2646c73a4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:48.962208 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ac456a0f-77b8-4a98-92a9-40c2646c73a4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:48.963153 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ac456a0f-77b8-4a98-92a9-40c2646c73a4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:48.963934 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ac456a0f-77b8-4a98-92a9-40c2646c73a4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:49.080368 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-ac456a0f-77b8-4a98-92a9-40c2646c73a4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lazy-loading 'services' on Instance uuid 3d279054-6318-480a-a1d1-2c4a46085141 {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:54:49.148768 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:49.162354 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ac456a0f-77b8-4a98-92a9-40c2646c73a4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/os-volume_attachments/a29334bd-8a46-401f-83bc-fa313efdf892" status: 202 len: 0 microversion: 2.1 time: 0.210743 Jun 20 18:54:49.163238 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 469/925] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jun 20 18:54:48 2022] DELETE /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/os-volume_attachments/a29334bd-8a46-401f-83bc-fa313efdf892 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 18:54:49.171762 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-73ff0466-9725-4d05-8a07-d965139d9a9f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:49.172777 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-73ff0466-9725-4d05-8a07-d965139d9a9f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:49.179489 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-73ff0466-9725-4d05-8a07-d965139d9a9f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:49.179939 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-73ff0466-9725-4d05-8a07-d965139d9a9f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:49.180715 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-73ff0466-9725-4d05-8a07-d965139d9a9f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:49.181145 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-73ff0466-9725-4d05-8a07-d965139d9a9f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:49.212745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9788ca5c-6928-4828-b141-0dc507a35259 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:49.213507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9788ca5c-6928-4828-b141-0dc507a35259 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] [instance: 4a86d158-0870-4597-be67-25d4f9371977] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:49.220980 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9788ca5c-6928-4828-b141-0dc507a35259 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:49.221428 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9788ca5c-6928-4828-b141-0dc507a35259 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:49.222186 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9788ca5c-6928-4828-b141-0dc507a35259 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:49.222621 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9788ca5c-6928-4828-b141-0dc507a35259 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:49.227566 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-73ff0466-9725-4d05-8a07-d965139d9a9f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059684 Jun 20 18:54:49.228140 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 457/926] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:54:49 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:54:49.243533 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-9788ca5c-6928-4828-b141-0dc507a35259 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] HTTP exception thrown: Instance 4a86d158-0870-4597-be67-25d4f9371977 could not be found. Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9788ca5c-6928-4828-b141-0dc507a35259 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Request method failure captured: Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 HTTP/1.1 Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMDgxGdD9NplnDOb9Kvkoi9z6IaPdYfKFk15cOFtxIEbZ3iM6js25CXsTI1b08r7rptp84JQv3s-L6cP6ceMNZuMSW6JZB2WSkrDda2t9Z9oJjBhawuAgtsiksYxhkCbb4o9vew5lG6pfzbGiHzTykEBsXAeqFgzCV--SlTvu97eD9o Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 7b4a919be31b4c74a3197d98ecec7fde Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:54:49.245171 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:54:49.246707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b4a919be31b4c74a3197d98ecec7fde", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b4a919be31b4c74a3197d98ecec7fde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b4a919be31b4c74a3197d98ecec7fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b4a919be31b4c74a3197d98ecec7fde"}]}] Jun 20 18:54:49.246707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:54:49.246707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 7b4a919be31b4c74a3197d98ecec7fde Jun 20 18:54:49.246707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-905734882 Jun 20 18:54:49.246707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-ServerRescueNegativeTestJSON-905734882-project Jun 20 18:54:49.246707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:54:49.246707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:54:49.246707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 31fed190cac24d1b8326425f737e220b Jun 20 18:54:49.246707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-ServerRescueNegativeTestJSON-905734882-project Jun 20 18:54:49.246707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:54:49.246707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance 4a86d158-0870-4597-be67-25d4f9371977 could not be found. Jun 20 18:54:49.246707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '4a86d158-0870-4597-be67-25d4f9371977'} Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a86d158-0870-4597-be67-25d4f9371977 could not be found. Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:54:49.247759 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a86d158-0870-4597-be67-25d4f9371977 could not be found. Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a86d158-0870-4597-be67-25d4f9371977 could not be found. Jun 20 18:54:49.249485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:54:49.250815 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9788ca5c-6928-4828-b141-0dc507a35259 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] Returning 404 to user: Instance 4a86d158-0870-4597-be67-25d4f9371977 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:54:49.250815 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9788ca5c-6928-4828-b141-0dc507a35259 tempest-ServerRescueNegativeTestJSON-905734882 tempest-ServerRescueNegativeTestJSON-905734882-project] 10.222.0.43 "GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977" status: 404 len: 111 microversion: 2.1 time: 0.038809 Jun 20 18:54:49.250815 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 470/927] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:49 2022] GET /compute/v2.1/servers/4a86d158-0870-4597-be67-25d4f9371977 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:54:50.239690 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6488be09-8c80-4dca-b7a9-37c323ba3a64 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:50.240647 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6488be09-8c80-4dca-b7a9-37c323ba3a64 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:50.247358 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6488be09-8c80-4dca-b7a9-37c323ba3a64 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:50.247882 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6488be09-8c80-4dca-b7a9-37c323ba3a64 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:50.248723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6488be09-8c80-4dca-b7a9-37c323ba3a64 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:50.249192 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6488be09-8c80-4dca-b7a9-37c323ba3a64 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:50.282576 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6488be09-8c80-4dca-b7a9-37c323ba3a64 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047669 Jun 20 18:54:50.283193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 458/928] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:54:50 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 18:54:50.350018 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f3821011-2773-4837-a9a4-4c8590aa6d82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:50.350543 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f3821011-2773-4837-a9a4-4c8590aa6d82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:50.358140 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f3821011-2773-4837-a9a4-4c8590aa6d82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:50.358665 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f3821011-2773-4837-a9a4-4c8590aa6d82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:50.359680 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f3821011-2773-4837-a9a4-4c8590aa6d82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:50.360229 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f3821011-2773-4837-a9a4-4c8590aa6d82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:50.387917 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f3821011-2773-4837-a9a4-4c8590aa6d82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Going to try to terminate instance {{(pid=124189) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:54:50.471894 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f3821011-2773-4837-a9a4-4c8590aa6d82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 204 len: 0 microversion: 2.1 time: 0.126305 Jun 20 18:54:50.472553 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 471/929] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:54:50 2022] DELETE /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:54:50.482847 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-dace1702-8143-423b-9b0b-28c848fb0648 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:50.483588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-dace1702-8143-423b-9b0b-28c848fb0648 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:50.489985 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dace1702-8143-423b-9b0b-28c848fb0648 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:50.490438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dace1702-8143-423b-9b0b-28c848fb0648 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:50.491376 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dace1702-8143-423b-9b0b-28c848fb0648 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:50.491692 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-dace1702-8143-423b-9b0b-28c848fb0648 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:50.511506 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:50.613683 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0838723a-e780-42b5-8ad5-47f70640fa94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:54:50.614751 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0838723a-e780-42b5-8ad5-47f70640fa94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:50.621139 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0838723a-e780-42b5-8ad5-47f70640fa94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:50.621578 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0838723a-e780-42b5-8ad5-47f70640fa94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:50.622563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0838723a-e780-42b5-8ad5-47f70640fa94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:50.623020 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0838723a-e780-42b5-8ad5-47f70640fa94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:50.633306 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-dace1702-8143-423b-9b0b-28c848fb0648 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:50.641757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-dace1702-8143-423b-9b0b-28c848fb0648 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1682 microversion: 2.1 time: 0.164145 Jun 20 18:54:50.642666 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 459/930] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:50 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:50.647487 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-0838723a-e780-42b5-8ad5-47f70640fa94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lazy-loading 'flavor' on Instance uuid dcb97000-4705-4f02-bdd0-00047a203abf {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:54:50.911802 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0838723a-e780-42b5-8ad5-47f70640fa94 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "POST /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf/action" status: 202 len: 0 microversion: 2.20 time: 0.302444 Jun 20 18:54:50.912538 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 472/931] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Jun 20 18:54:50 2022] POST /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:54:50.921103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-55a0a29d-552e-4b89-89c7-24fe684fd7d7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:50.921709 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-55a0a29d-552e-4b89-89c7-24fe684fd7d7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:50.928344 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-55a0a29d-552e-4b89-89c7-24fe684fd7d7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:50.928793 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-55a0a29d-552e-4b89-89c7-24fe684fd7d7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:50.929554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-55a0a29d-552e-4b89-89c7-24fe684fd7d7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:50.929988 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-55a0a29d-552e-4b89-89c7-24fe684fd7d7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:51.303925 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-55a0a29d-552e-4b89-89c7-24fe684fd7d7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:51.316919 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-55a0a29d-552e-4b89-89c7-24fe684fd7d7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:51.319412 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-55a0a29d-552e-4b89-89c7-24fe684fd7d7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:51.320805 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-55a0a29d-552e-4b89-89c7-24fe684fd7d7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1724 microversion: 2.20 time: 0.403830 Jun 20 18:54:51.332638 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 460/932] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:54:50 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:54:51.659882 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-868b73ba-a1f0-4062-a4e6-37257a9e774e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:51.660689 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-868b73ba-a1f0-4062-a4e6-37257a9e774e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:51.667331 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-868b73ba-a1f0-4062-a4e6-37257a9e774e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:51.667853 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-868b73ba-a1f0-4062-a4e6-37257a9e774e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:51.668707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-868b73ba-a1f0-4062-a4e6-37257a9e774e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:51.669217 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-868b73ba-a1f0-4062-a4e6-37257a9e774e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:51.852220 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-868b73ba-a1f0-4062-a4e6-37257a9e774e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:51.860238 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-868b73ba-a1f0-4062-a4e6-37257a9e774e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1682 microversion: 2.1 time: 0.205083 Jun 20 18:54:51.860895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 473/933] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:51 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:52.340601 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e0db4903-fb17-439b-b78f-b7ac2ee28a1f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:52.341471 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e0db4903-fb17-439b-b78f-b7ac2ee28a1f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:52.349859 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0db4903-fb17-439b-b78f-b7ac2ee28a1f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:52.350557 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0db4903-fb17-439b-b78f-b7ac2ee28a1f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:52.351582 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0db4903-fb17-439b-b78f-b7ac2ee28a1f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:52.352245 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0db4903-fb17-439b-b78f-b7ac2ee28a1f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:52.591555 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e0db4903-fb17-439b-b78f-b7ac2ee28a1f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:52.601163 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e0db4903-fb17-439b-b78f-b7ac2ee28a1f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:52.603121 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e0db4903-fb17-439b-b78f-b7ac2ee28a1f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:52.604511 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e0db4903-fb17-439b-b78f-b7ac2ee28a1f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1724 microversion: 2.20 time: 0.268318 Jun 20 18:54:52.605943 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 461/934] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:54:52 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:54:52.877526 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8c9ce149-0eb4-4431-a80b-a5045956b462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:52.878747 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8c9ce149-0eb4-4431-a80b-a5045956b462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:52.885947 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8c9ce149-0eb4-4431-a80b-a5045956b462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:52.886390 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8c9ce149-0eb4-4431-a80b-a5045956b462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:52.887183 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8c9ce149-0eb4-4431-a80b-a5045956b462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:52.887616 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8c9ce149-0eb4-4431-a80b-a5045956b462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:53.118768 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8c9ce149-0eb4-4431-a80b-a5045956b462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:53.128260 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8c9ce149-0eb4-4431-a80b-a5045956b462 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 200 len: 1682 microversion: 2.1 time: 0.254274 Jun 20 18:54:53.129357 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 474/935] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:52 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 1682 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:53.507561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-0255aa3a-9f96-409e-93ca-dd39d559f3f0 req-df8dcede-ced4-4c7b-a16f-83901449b07c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d279054-6318-480a-a1d1-2c4a46085141", "name": "network-vif-deleted", "tag": "061cd6f0-1710-4a3f-b086-37006d8f926a"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:54:53.519838 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-0255aa3a-9f96-409e-93ca-dd39d559f3f0 req-df8dcede-ced4-4c7b-a16f-83901449b07c service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:53.522069 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-0255aa3a-9f96-409e-93ca-dd39d559f3f0 req-df8dcede-ced4-4c7b-a16f-83901449b07c service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:53.535912 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-0255aa3a-9f96-409e-93ca-dd39d559f3f0 req-df8dcede-ced4-4c7b-a16f-83901449b07c service nova] Creating event network-vif-deleted:061cd6f0-1710-4a3f-b086-37006d8f926a for instance 3d279054-6318-480a-a1d1-2c4a46085141 on hv-cinder-83697 Jun 20 18:54:53.542403 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-0255aa3a-9f96-409e-93ca-dd39d559f3f0 req-df8dcede-ced4-4c7b-a16f-83901449b07c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038104 Jun 20 18:54:53.546862 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 462/936] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:54:53.624164 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b866d828-b556-47f3-adfe-149736ba0e98 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:53.624780 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b866d828-b556-47f3-adfe-149736ba0e98 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:53.636212 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b866d828-b556-47f3-adfe-149736ba0e98 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:53.636657 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b866d828-b556-47f3-adfe-149736ba0e98 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:53.639387 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b866d828-b556-47f3-adfe-149736ba0e98 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:53.639838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b866d828-b556-47f3-adfe-149736ba0e98 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:53.859958 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b866d828-b556-47f3-adfe-149736ba0e98 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:53.875033 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b866d828-b556-47f3-adfe-149736ba0e98 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:53.876545 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b866d828-b556-47f3-adfe-149736ba0e98 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:53.877882 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b866d828-b556-47f3-adfe-149736ba0e98 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1724 microversion: 2.20 time: 0.258158 Jun 20 18:54:53.878490 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 475/937] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:54:53 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:54:54.146797 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c886391f-3ac9-454b-a14a-1edb1ac5c439 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:54.147653 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c886391f-3ac9-454b-a14a-1edb1ac5c439 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:54.154410 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c886391f-3ac9-454b-a14a-1edb1ac5c439 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:54.155129 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c886391f-3ac9-454b-a14a-1edb1ac5c439 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:54.156353 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c886391f-3ac9-454b-a14a-1edb1ac5c439 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:54.157039 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c886391f-3ac9-454b-a14a-1edb1ac5c439 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:54.172690 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-c886391f-3ac9-454b-a14a-1edb1ac5c439 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] HTTP exception thrown: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c886391f-3ac9-454b-a14a-1edb1ac5c439 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Request method failure captured: Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 HTTP/1.1 Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMB7oKpb5ufs7k91aATNwQ9lBCFsAiscF2D6zDu63Pdu1lDJfudYPQfg-WIoWYQQ-JgV04sOxsJj7QlSIQrKVCkKsbiXYH3d8jdfXZNL0OxCyUpor2PA81B48M0Ll8y0cg4uK3b5-fQlEg3o6bUpvXP-E4SmBiu6KFl4dytZBttHh-M Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:54:54.174331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:54:54.175668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8006d78bc1604611b3254b5efa451288", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8006d78bc1604611b3254b5efa451288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}] Jun 20 18:54:54.175668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:54:54.175668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:54:54.175668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:54:54.175668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:54:54.175668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:54:54.175668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:54:54.175668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: c3134832f2a647aab761da347f7e9fd4 Jun 20 18:54:54.175668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:54:54.175668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:54:54.175668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:54:54.175668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': '3d279054-6318-480a-a1d1-2c4a46085141'} Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:54:54.176714 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:54:54.178138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:54:54.180112 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c886391f-3ac9-454b-a14a-1edb1ac5c439 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Returning 404 to user: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:54:54.180112 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c886391f-3ac9-454b-a14a-1edb1ac5c439 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 404 len: 111 microversion: 2.1 time: 0.033159 Jun 20 18:54:54.180112 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 463/938] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:54 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:54:54.185476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-52f8f723-b736-4562-b9ae-152678422a91 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '.version_select at 0x7f7e448f6af0>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:54.207004 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-52f8f723-b736-4562-b9ae-152678422a91 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-806128802" status: 202 len: 0 microversion: 2.1 time: 0.025309 Jun 20 18:54:54.209037 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 476/939] 10.222.0.43 () {58 vars in 1217 bytes} [Mon Jun 20 18:54:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-806128802 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:54:54.899978 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b5ce4989-c634-4b57-9edd-0ec3f7d36bb3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:54.901067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b5ce4989-c634-4b57-9edd-0ec3f7d36bb3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:54.911871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c6246d0e-a06c-4b4e-ad63-876d8f0a016d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Action: 'create', calling method: .version_select at 0x7f7e4483e700>, body: {"keypair": {"name": "tempest-keypair-704521901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPOzfWRzqP//b99ztWVsXWdpYBt/hlsbzMkP5WZ4QHi5F84CLPd9p3yhmkJpT44KqXA+lVi7sYPnPClEQCJrZfd0CZd0j1duB1cSV4yxbEnGkd5TTqN+PeyrDS3JErz3g=="}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:54:54.914942 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b5ce4989-c634-4b57-9edd-0ec3f7d36bb3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:54.914942 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b5ce4989-c634-4b57-9edd-0ec3f7d36bb3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:54.915527 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b5ce4989-c634-4b57-9edd-0ec3f7d36bb3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:54.916250 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b5ce4989-c634-4b57-9edd-0ec3f7d36bb3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:54.926761 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-c6246d0e-a06c-4b4e-ad63-876d8f0a016d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for project 8006d78bc1604611b3254b5efa451288. Resources: {'key_pairs'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:54:54.930573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-c6246d0e-a06c-4b4e-ad63-876d8f0a016d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for user c3134832f2a647aab761da347f7e9fd4 and project 8006d78bc1604611b3254b5efa451288. Resources: {'key_pairs'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:54:54.962033 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c6246d0e-a06c-4b4e-ad63-876d8f0a016d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054069 Jun 20 18:54:54.962624 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 477/940] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jun 20 18:54:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:54:55.080791 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b5ce4989-c634-4b57-9edd-0ec3f7d36bb3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:55.089043 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b5ce4989-c634-4b57-9edd-0ec3f7d36bb3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:55.090592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b5ce4989-c634-4b57-9edd-0ec3f7d36bb3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:55.091849 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b5ce4989-c634-4b57-9edd-0ec3f7d36bb3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1724 microversion: 2.20 time: 0.199666 Jun 20 18:54:55.092779 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 464/941] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:54:54 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:54:56.117001 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-05be89b7-4cd1-4fa9-a7ec-777c8e56b39c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:56.117628 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-05be89b7-4cd1-4fa9-a7ec-777c8e56b39c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:56.123929 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-05be89b7-4cd1-4fa9-a7ec-777c8e56b39c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:56.124382 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-05be89b7-4cd1-4fa9-a7ec-777c8e56b39c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:56.125154 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-05be89b7-4cd1-4fa9-a7ec-777c8e56b39c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:56.125591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-05be89b7-4cd1-4fa9-a7ec-777c8e56b39c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:56.225674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1832475645", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26505b1c-460a-483f-99b8-daa82e0cee5d"}], "security_groups": [{"name": "tempest-securitygroup--1792355875"}], "key_name": "tempest-keypair-704521901", "user_data": "}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:54:56.265922 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-05be89b7-4cd1-4fa9-a7ec-777c8e56b39c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:56.274177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-05be89b7-4cd1-4fa9-a7ec-777c8e56b39c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:56.275723 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-05be89b7-4cd1-4fa9-a7ec-777c8e56b39c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:56.277223 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-05be89b7-4cd1-4fa9-a7ec-777c8e56b39c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1724 microversion: 2.20 time: 0.171136 Jun 20 18:54:56.277926 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 478/942] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:54:56 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:54:56.341349 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.network.neutron [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] validate_networks() for [('26505b1c-460a-483f-99b8-daa82e0cee5d', None, None, None, None, None)] {{(pid=124190) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:54:56.797996 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Flavor limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:54:56.798418 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Image limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:54:56.798887 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Flavor pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:54:56.799321 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Image pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:54:56.799727 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:54:56.808972 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:56.809449 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:56.810242 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:56.810676 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:56.827347 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for project 8006d78bc1604611b3254b5efa451288. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:54:56.831278 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Getting quotas for user c3134832f2a647aab761da347f7e9fd4 and project 8006d78bc1604611b3254b5efa451288. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:54:56.842083 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Going to run 1 instances... {{(pid=124190) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:54:56.844319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124190) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:54:56.889851 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-76f9677a-341d-4f8e-af56-136e65b99bd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.668923 Jun 20 18:54:56.890487 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 465/943] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:54:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:54:56.900514 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b6ceb25c-42b2-43f6-b2ac-e01e1f1cec7f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:56.901121 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b6ceb25c-42b2-43f6-b2ac-e01e1f1cec7f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:56.956488 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b6ceb25c-42b2-43f6-b2ac-e01e1f1cec7f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:56.963269 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b6ceb25c-42b2-43f6-b2ac-e01e1f1cec7f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1241 microversion: 2.1 time: 0.066601 Jun 20 18:54:56.963915 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 479/944] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:56 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:57.297043 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-68da93fe-9810-4378-8688-86b24cfa8d7c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:57.297619 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-68da93fe-9810-4378-8688-86b24cfa8d7c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:57.304560 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-68da93fe-9810-4378-8688-86b24cfa8d7c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:57.305009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-68da93fe-9810-4378-8688-86b24cfa8d7c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:57.305781 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-68da93fe-9810-4378-8688-86b24cfa8d7c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:57.306218 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-68da93fe-9810-4378-8688-86b24cfa8d7c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:57.440844 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-68da93fe-9810-4378-8688-86b24cfa8d7c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:57.450461 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-68da93fe-9810-4378-8688-86b24cfa8d7c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:57.451942 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-68da93fe-9810-4378-8688-86b24cfa8d7c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:57.453140 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-68da93fe-9810-4378-8688-86b24cfa8d7c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1724 microversion: 2.20 time: 0.161096 Jun 20 18:54:57.453885 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 466/945] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:54:57 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:54:57.981325 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-bacc116d-1d17-4ed3-85fe-05621a584765 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:57.982033 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-bacc116d-1d17-4ed3-85fe-05621a584765 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:57.990027 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bacc116d-1d17-4ed3-85fe-05621a584765 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:57.990518 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bacc116d-1d17-4ed3-85fe-05621a584765 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:57.991551 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bacc116d-1d17-4ed3-85fe-05621a584765 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:57.992101 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bacc116d-1d17-4ed3-85fe-05621a584765 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:58.080098 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-bacc116d-1d17-4ed3-85fe-05621a584765 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:58.089241 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-bacc116d-1d17-4ed3-85fe-05621a584765 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1299 microversion: 2.1 time: 0.112455 Jun 20 18:54:58.090180 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 480/946] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:57 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:58.471565 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d19f50c8-919d-4835-bb3a-081f96606d6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:58.472166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d19f50c8-919d-4835-bb3a-081f96606d6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:58.479187 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d19f50c8-919d-4835-bb3a-081f96606d6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:58.479640 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d19f50c8-919d-4835-bb3a-081f96606d6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:58.480394 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d19f50c8-919d-4835-bb3a-081f96606d6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:58.480824 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d19f50c8-919d-4835-bb3a-081f96606d6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:58.633071 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d19f50c8-919d-4835-bb3a-081f96606d6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:58.641145 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d19f50c8-919d-4835-bb3a-081f96606d6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:58.642634 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d19f50c8-919d-4835-bb3a-081f96606d6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:58.643942 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d19f50c8-919d-4835-bb3a-081f96606d6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1724 microversion: 2.20 time: 0.176449 Jun 20 18:54:58.644504 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 467/947] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:54:58 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:54:59.108144 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f286a9eb-1d79-4ea6-beba-3249f78edac1 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:59.108663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f286a9eb-1d79-4ea6-beba-3249f78edac1 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:59.115279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f286a9eb-1d79-4ea6-beba-3249f78edac1 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:59.115659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f286a9eb-1d79-4ea6-beba-3249f78edac1 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:59.116414 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f286a9eb-1d79-4ea6-beba-3249f78edac1 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:59.116849 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f286a9eb-1d79-4ea6-beba-3249f78edac1 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:59.610572 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f286a9eb-1d79-4ea6-beba-3249f78edac1 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:59.618200 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f286a9eb-1d79-4ea6-beba-3249f78edac1 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1367 microversion: 2.1 time: 0.514339 Jun 20 18:54:59.618967 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 481/948] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:54:59 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1367 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:54:59.662663 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-78235ed7-787d-4bc0-a623-30891e2ae2b9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:54:59.663446 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-78235ed7-787d-4bc0-a623-30891e2ae2b9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:54:59.671009 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-78235ed7-787d-4bc0-a623-30891e2ae2b9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:59.671858 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-78235ed7-787d-4bc0-a623-30891e2ae2b9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:59.672709 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-78235ed7-787d-4bc0-a623-30891e2ae2b9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:54:59.673224 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-78235ed7-787d-4bc0-a623-30891e2ae2b9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:54:59.857202 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-78235ed7-787d-4bc0-a623-30891e2ae2b9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:59.865616 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-78235ed7-787d-4bc0-a623-30891e2ae2b9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:59.868339 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-78235ed7-787d-4bc0-a623-30891e2ae2b9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:54:59.869602 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-78235ed7-787d-4bc0-a623-30891e2ae2b9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1724 microversion: 2.20 time: 0.211913 Jun 20 18:54:59.883000 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 468/949] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:54:59 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:54:59.991186 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-9423d0e4-bf5a-4c50-bf8e-37e66c6b9d64 req-a017685d-9089-45e1-9e10-0b8bb38602f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3cd7486-00ce-4ee1-a280-48d2720f8d0a", "tag": "cfb96e54-b9ce-42bf-8b8d-34ef813c73bc"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:55:00.006754 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-9423d0e4-bf5a-4c50-bf8e-37e66c6b9d64 req-a017685d-9089-45e1-9e10-0b8bb38602f6 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:00.007230 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-9423d0e4-bf5a-4c50-bf8e-37e66c6b9d64 req-a017685d-9089-45e1-9e10-0b8bb38602f6 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:00.019349 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-9423d0e4-bf5a-4c50-bf8e-37e66c6b9d64 req-a017685d-9089-45e1-9e10-0b8bb38602f6 service nova] Creating event network-changed:cfb96e54-b9ce-42bf-8b8d-34ef813c73bc for instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a on hv-cinder-83697 Jun 20 18:55:00.032669 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-9423d0e4-bf5a-4c50-bf8e-37e66c6b9d64 req-a017685d-9089-45e1-9e10-0b8bb38602f6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045308 Jun 20 18:55:00.033346 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 482/950] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:55:00.634356 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-99b7d875-f43f-44e2-b15a-fff0c3379152 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:00.634984 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-99b7d875-f43f-44e2-b15a-fff0c3379152 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:00.640947 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-99b7d875-f43f-44e2-b15a-fff0c3379152 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:00.641390 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-99b7d875-f43f-44e2-b15a-fff0c3379152 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:00.642139 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-99b7d875-f43f-44e2-b15a-fff0c3379152 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:00.642566 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-99b7d875-f43f-44e2-b15a-fff0c3379152 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:00.780040 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-99b7d875-f43f-44e2-b15a-fff0c3379152 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:00.787598 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-99b7d875-f43f-44e2-b15a-fff0c3379152 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1367 microversion: 2.1 time: 0.157024 Jun 20 18:55:00.788158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 469/951] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:00 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:00.888639 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-275ec368-eb2c-49c4-b8d2-6874c71e6126 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:00.889422 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-275ec368-eb2c-49c4-b8d2-6874c71e6126 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:00.896921 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-275ec368-eb2c-49c4-b8d2-6874c71e6126 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:00.897381 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-275ec368-eb2c-49c4-b8d2-6874c71e6126 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:00.898320 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-275ec368-eb2c-49c4-b8d2-6874c71e6126 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:00.898766 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-275ec368-eb2c-49c4-b8d2-6874c71e6126 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:01.027415 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-275ec368-eb2c-49c4-b8d2-6874c71e6126 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:01.035765 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-275ec368-eb2c-49c4-b8d2-6874c71e6126 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:01.037285 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-275ec368-eb2c-49c4-b8d2-6874c71e6126 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:01.038447 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-275ec368-eb2c-49c4-b8d2-6874c71e6126 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1724 microversion: 2.20 time: 0.154576 Jun 20 18:55:01.039275 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 483/952] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:00 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:01.804333 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4099e8be-550b-4248-b41b-78d88801738a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:01.804949 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-4099e8be-550b-4248-b41b-78d88801738a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:01.811632 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4099e8be-550b-4248-b41b-78d88801738a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:01.812109 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4099e8be-550b-4248-b41b-78d88801738a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:01.812903 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4099e8be-550b-4248-b41b-78d88801738a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:01.813337 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4099e8be-550b-4248-b41b-78d88801738a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:01.986042 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4099e8be-550b-4248-b41b-78d88801738a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:01.994044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4099e8be-550b-4248-b41b-78d88801738a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1367 microversion: 2.1 time: 0.194117 Jun 20 18:55:01.994614 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 470/953] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:01 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:02.056447 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ddfaf0c5-6b9d-466e-8453-b01d130c479c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:02.057199 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ddfaf0c5-6b9d-466e-8453-b01d130c479c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:02.063828 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ddfaf0c5-6b9d-466e-8453-b01d130c479c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:02.064271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ddfaf0c5-6b9d-466e-8453-b01d130c479c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:02.065041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ddfaf0c5-6b9d-466e-8453-b01d130c479c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:02.065480 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ddfaf0c5-6b9d-466e-8453-b01d130c479c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:02.256084 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ddfaf0c5-6b9d-466e-8453-b01d130c479c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:02.264581 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ddfaf0c5-6b9d-466e-8453-b01d130c479c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:02.266059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ddfaf0c5-6b9d-466e-8453-b01d130c479c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:02.267275 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ddfaf0c5-6b9d-466e-8453-b01d130c479c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1724 microversion: 2.20 time: 0.214700 Jun 20 18:55:02.267850 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 484/954] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:02 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:03.011681 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-60316cbc-8fce-4412-b7d0-8cbd0d218e3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:03.012607 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-60316cbc-8fce-4412-b7d0-8cbd0d218e3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:03.020297 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:03.022809 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-60316cbc-8fce-4412-b7d0-8cbd0d218e3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:03.023283 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-60316cbc-8fce-4412-b7d0-8cbd0d218e3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:03.024078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-60316cbc-8fce-4412-b7d0-8cbd0d218e3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:03.024509 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-60316cbc-8fce-4412-b7d0-8cbd0d218e3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:03.174011 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-60316cbc-8fce-4412-b7d0-8cbd0d218e3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:03.183750 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-60316cbc-8fce-4412-b7d0-8cbd0d218e3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1367 microversion: 2.1 time: 0.176379 Jun 20 18:55:03.184562 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 471/955] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:03 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:03.286581 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-025cb70d-2789-4b3a-807a-89acc78f9d2a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:03.287275 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-025cb70d-2789-4b3a-807a-89acc78f9d2a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:03.289912 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:03.295345 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-025cb70d-2789-4b3a-807a-89acc78f9d2a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:03.295794 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-025cb70d-2789-4b3a-807a-89acc78f9d2a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:03.296557 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-025cb70d-2789-4b3a-807a-89acc78f9d2a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:03.296990 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-025cb70d-2789-4b3a-807a-89acc78f9d2a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:03.430959 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-025cb70d-2789-4b3a-807a-89acc78f9d2a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:03.439021 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-025cb70d-2789-4b3a-807a-89acc78f9d2a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:03.440522 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-025cb70d-2789-4b3a-807a-89acc78f9d2a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:03.441671 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-025cb70d-2789-4b3a-807a-89acc78f9d2a tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1724 microversion: 2.20 time: 0.159697 Jun 20 18:55:03.442228 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 485/956] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:03 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:04.200387 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7a3b975e-fba0-411d-b7e7-ab7dc7c17d6e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:04.201116 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7a3b975e-fba0-411d-b7e7-ab7dc7c17d6e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:04.208057 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7a3b975e-fba0-411d-b7e7-ab7dc7c17d6e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:04.208734 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7a3b975e-fba0-411d-b7e7-ab7dc7c17d6e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:04.210212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7a3b975e-fba0-411d-b7e7-ab7dc7c17d6e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:04.210212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7a3b975e-fba0-411d-b7e7-ab7dc7c17d6e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:04.357908 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7a3b975e-fba0-411d-b7e7-ab7dc7c17d6e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:04.367464 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7a3b975e-fba0-411d-b7e7-ab7dc7c17d6e tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1367 microversion: 2.1 time: 0.171042 Jun 20 18:55:04.368555 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 472/957] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:04 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:04.460543 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-efc38b54-8cee-45fa-8a3a-3c97ed87af8d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:04.461152 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-efc38b54-8cee-45fa-8a3a-3c97ed87af8d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:04.467559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-efc38b54-8cee-45fa-8a3a-3c97ed87af8d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:04.468006 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-efc38b54-8cee-45fa-8a3a-3c97ed87af8d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:04.468767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-efc38b54-8cee-45fa-8a3a-3c97ed87af8d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:04.469196 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-efc38b54-8cee-45fa-8a3a-3c97ed87af8d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:04.607886 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-efc38b54-8cee-45fa-8a3a-3c97ed87af8d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:04.616414 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-efc38b54-8cee-45fa-8a3a-3c97ed87af8d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:04.617847 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-efc38b54-8cee-45fa-8a3a-3c97ed87af8d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:04.619024 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-efc38b54-8cee-45fa-8a3a-3c97ed87af8d tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1745 microversion: 2.20 time: 0.163350 Jun 20 18:55:04.619582 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 486/958] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:04 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:05.385811 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0602b4bf-982e-4ef6-9a77-564e9add403b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:05.386533 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0602b4bf-982e-4ef6-9a77-564e9add403b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:05.394209 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0602b4bf-982e-4ef6-9a77-564e9add403b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:05.394738 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0602b4bf-982e-4ef6-9a77-564e9add403b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:05.396387 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0602b4bf-982e-4ef6-9a77-564e9add403b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:05.397044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0602b4bf-982e-4ef6-9a77-564e9add403b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:05.552053 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0602b4bf-982e-4ef6-9a77-564e9add403b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:05.559763 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0602b4bf-982e-4ef6-9a77-564e9add403b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1367 microversion: 2.1 time: 0.178377 Jun 20 18:55:05.562621 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 473/959] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:05 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:05.638004 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f9aac85e-d5d7-44e4-8f8b-8c0d0520e8ac tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:05.638727 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f9aac85e-d5d7-44e4-8f8b-8c0d0520e8ac tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:05.644566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f9aac85e-d5d7-44e4-8f8b-8c0d0520e8ac tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:05.645227 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f9aac85e-d5d7-44e4-8f8b-8c0d0520e8ac tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:05.646155 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f9aac85e-d5d7-44e4-8f8b-8c0d0520e8ac tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:05.646749 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f9aac85e-d5d7-44e4-8f8b-8c0d0520e8ac tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:05.665465 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:05.797256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f9aac85e-d5d7-44e4-8f8b-8c0d0520e8ac tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:05.806167 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f9aac85e-d5d7-44e4-8f8b-8c0d0520e8ac tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:05.807838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f9aac85e-d5d7-44e4-8f8b-8c0d0520e8ac tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:05.809005 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f9aac85e-d5d7-44e4-8f8b-8c0d0520e8ac tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1745 microversion: 2.20 time: 0.175391 Jun 20 18:55:05.809552 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 487/960] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:05 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:06.577545 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-81743f77-a00b-4015-8acd-2d8ef06fcf3f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:06.578415 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-81743f77-a00b-4015-8acd-2d8ef06fcf3f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:06.585376 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-81743f77-a00b-4015-8acd-2d8ef06fcf3f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:06.585824 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-81743f77-a00b-4015-8acd-2d8ef06fcf3f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:06.586607 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-81743f77-a00b-4015-8acd-2d8ef06fcf3f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:06.587060 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-81743f77-a00b-4015-8acd-2d8ef06fcf3f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:06.714503 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-81743f77-a00b-4015-8acd-2d8ef06fcf3f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:06.722729 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-81743f77-a00b-4015-8acd-2d8ef06fcf3f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1367 microversion: 2.1 time: 0.149186 Jun 20 18:55:06.723934 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 474/961] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:06 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:06.828069 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-01f7dfa6-409a-4142-858d-013550825103 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:06.828670 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-01f7dfa6-409a-4142-858d-013550825103 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:06.835176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-01f7dfa6-409a-4142-858d-013550825103 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:06.835628 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-01f7dfa6-409a-4142-858d-013550825103 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:06.836384 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-01f7dfa6-409a-4142-858d-013550825103 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:06.836825 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-01f7dfa6-409a-4142-858d-013550825103 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:06.963081 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-01f7dfa6-409a-4142-858d-013550825103 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:06.965228 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=6 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:06.972574 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-01f7dfa6-409a-4142-858d-013550825103 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:06.974476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-01f7dfa6-409a-4142-858d-013550825103 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:06.975662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-01f7dfa6-409a-4142-858d-013550825103 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1745 microversion: 2.20 time: 0.151485 Jun 20 18:55:06.976215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 488/962] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:06 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:07.740731 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-51aba861-efcd-4aea-bba4-64894a0e6f82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:07.741340 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-51aba861-efcd-4aea-bba4-64894a0e6f82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:07.743271 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:07.743950 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=6 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:07.750554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-51aba861-efcd-4aea-bba4-64894a0e6f82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:07.751030 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-51aba861-efcd-4aea-bba4-64894a0e6f82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:07.751794 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-51aba861-efcd-4aea-bba4-64894a0e6f82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:07.752232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-51aba861-efcd-4aea-bba4-64894a0e6f82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:07.879148 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-51aba861-efcd-4aea-bba4-64894a0e6f82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:07.886683 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-51aba861-efcd-4aea-bba4-64894a0e6f82 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1367 microversion: 2.1 time: 0.150377 Jun 20 18:55:07.887271 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 475/963] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:07 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:07.993909 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d3a01925-5642-492b-8068-5c5367b031cc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:07.994512 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d3a01925-5642-492b-8068-5c5367b031cc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:08.000970 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d3a01925-5642-492b-8068-5c5367b031cc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:08.001410 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d3a01925-5642-492b-8068-5c5367b031cc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:08.002165 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d3a01925-5642-492b-8068-5c5367b031cc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:08.002588 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d3a01925-5642-492b-8068-5c5367b031cc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:08.143609 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d3a01925-5642-492b-8068-5c5367b031cc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:08.151994 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d3a01925-5642-492b-8068-5c5367b031cc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:08.153524 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d3a01925-5642-492b-8068-5c5367b031cc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:08.154673 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d3a01925-5642-492b-8068-5c5367b031cc tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1745 microversion: 2.20 time: 0.164738 Jun 20 18:55:08.155297 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 489/964] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:07 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:08.346981 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-397644ad-5349-49b5-b2d7-c581b584cac7 req-1c454d83-8028-4cf8-8433-79c8d32fad19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb97000-4705-4f02-bdd0-00047a203abf", "name": "network-vif-plugged", "status": "completed", "tag": "d20d672a-4e79-42b8-b764-55a554f24b8b"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:55:08.355946 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-397644ad-5349-49b5-b2d7-c581b584cac7 req-1c454d83-8028-4cf8-8433-79c8d32fad19 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:08.356394 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-397644ad-5349-49b5-b2d7-c581b584cac7 req-1c454d83-8028-4cf8-8433-79c8d32fad19 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:08.367208 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-397644ad-5349-49b5-b2d7-c581b584cac7 req-1c454d83-8028-4cf8-8433-79c8d32fad19 service nova] Creating event network-vif-plugged:d20d672a-4e79-42b8-b764-55a554f24b8b for instance dcb97000-4705-4f02-bdd0-00047a203abf on hv-cinder-83697 Jun 20 18:55:08.372646 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-397644ad-5349-49b5-b2d7-c581b584cac7 req-1c454d83-8028-4cf8-8433-79c8d32fad19 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029368 Jun 20 18:55:08.373441 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 476/965] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:55:08.903903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e9339b93-3a85-44e5-b7d8-2c8581d3e806 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:08.904434 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e9339b93-3a85-44e5-b7d8-2c8581d3e806 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:08.910389 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e9339b93-3a85-44e5-b7d8-2c8581d3e806 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:08.911442 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e9339b93-3a85-44e5-b7d8-2c8581d3e806 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:08.912191 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e9339b93-3a85-44e5-b7d8-2c8581d3e806 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:08.912616 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e9339b93-3a85-44e5-b7d8-2c8581d3e806 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:09.039504 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e9339b93-3a85-44e5-b7d8-2c8581d3e806 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:09.047063 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e9339b93-3a85-44e5-b7d8-2c8581d3e806 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1367 microversion: 2.1 time: 0.147070 Jun 20 18:55:09.047622 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 490/966] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:08 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:09.173906 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-40391ac7-2703-492d-a6fa-24b9b26636bb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:09.174523 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-40391ac7-2703-492d-a6fa-24b9b26636bb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:09.181223 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-40391ac7-2703-492d-a6fa-24b9b26636bb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:09.181647 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-40391ac7-2703-492d-a6fa-24b9b26636bb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:09.182404 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-40391ac7-2703-492d-a6fa-24b9b26636bb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:09.182841 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-40391ac7-2703-492d-a6fa-24b9b26636bb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:09.315323 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-40391ac7-2703-492d-a6fa-24b9b26636bb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:09.323932 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-40391ac7-2703-492d-a6fa-24b9b26636bb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:09.325449 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-40391ac7-2703-492d-a6fa-24b9b26636bb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:09.326593 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-40391ac7-2703-492d-a6fa-24b9b26636bb tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1745 microversion: 2.20 time: 0.157006 Jun 20 18:55:09.327169 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 477/967] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:09 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:10.063164 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-de02873f-982c-4ad3-8880-92a3ba5776f6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:10.063774 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-de02873f-982c-4ad3-8880-92a3ba5776f6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:10.070757 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-de02873f-982c-4ad3-8880-92a3ba5776f6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:10.071282 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-de02873f-982c-4ad3-8880-92a3ba5776f6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:10.072182 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-de02873f-982c-4ad3-8880-92a3ba5776f6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:10.072691 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-de02873f-982c-4ad3-8880-92a3ba5776f6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:10.216821 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-de02873f-982c-4ad3-8880-92a3ba5776f6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:10.227058 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-de02873f-982c-4ad3-8880-92a3ba5776f6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1367 microversion: 2.1 time: 0.167676 Jun 20 18:55:10.231614 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 491/968] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:10 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:10.345276 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-765194f0-a422-4007-b3c1-94779b98e5e6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:10.345877 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-765194f0-a422-4007-b3c1-94779b98e5e6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:10.353890 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-765194f0-a422-4007-b3c1-94779b98e5e6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:10.355407 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-765194f0-a422-4007-b3c1-94779b98e5e6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:10.356438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-765194f0-a422-4007-b3c1-94779b98e5e6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:10.357215 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-765194f0-a422-4007-b3c1-94779b98e5e6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:10.394485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-c79ed42a-dbeb-4216-844a-2e095819847f req-64af8d62-a89a-4e67-874a-971c69de14a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3cd7486-00ce-4ee1-a280-48d2720f8d0a", "name": "network-vif-plugged", "status": "completed", "tag": "cfb96e54-b9ce-42bf-8b8d-34ef813c73bc"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:55:10.404152 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-c79ed42a-dbeb-4216-844a-2e095819847f req-64af8d62-a89a-4e67-874a-971c69de14a3 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:10.404602 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-c79ed42a-dbeb-4216-844a-2e095819847f req-64af8d62-a89a-4e67-874a-971c69de14a3 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:10.417615 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-c79ed42a-dbeb-4216-844a-2e095819847f req-64af8d62-a89a-4e67-874a-971c69de14a3 service nova] Creating event network-vif-plugged:cfb96e54-b9ce-42bf-8b8d-34ef813c73bc for instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a on hv-cinder-83697 Jun 20 18:55:10.422709 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-c79ed42a-dbeb-4216-844a-2e095819847f req-64af8d62-a89a-4e67-874a-971c69de14a3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033398 Jun 20 18:55:10.423549 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 492/969] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:55:10.517700 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-765194f0-a422-4007-b3c1-94779b98e5e6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:10.524570 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=100 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:10.531772 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-765194f0-a422-4007-b3c1-94779b98e5e6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:10.533136 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-765194f0-a422-4007-b3c1-94779b98e5e6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:10.534687 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-765194f0-a422-4007-b3c1-94779b98e5e6 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1740 microversion: 2.20 time: 0.193333 Jun 20 18:55:10.535433 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 478/970] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:10 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:11.245845 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-758bf10d-53be-47bc-9a3b-d71c73ff8c73 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:11.247197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-758bf10d-53be-47bc-9a3b-d71c73ff8c73 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:11.253652 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-758bf10d-53be-47bc-9a3b-d71c73ff8c73 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:11.254834 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-758bf10d-53be-47bc-9a3b-d71c73ff8c73 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:11.255946 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-758bf10d-53be-47bc-9a3b-d71c73ff8c73 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:11.256533 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-758bf10d-53be-47bc-9a3b-d71c73ff8c73 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:11.416211 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-758bf10d-53be-47bc-9a3b-d71c73ff8c73 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:11.424553 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-758bf10d-53be-47bc-9a3b-d71c73ff8c73 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1367 microversion: 2.1 time: 0.183450 Jun 20 18:55:11.425599 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 493/971] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:11 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:11.554400 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2e112378-eac1-4669-8de8-21d2016488fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:11.555311 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2e112378-eac1-4669-8de8-21d2016488fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:11.562416 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2e112378-eac1-4669-8de8-21d2016488fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:11.563135 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2e112378-eac1-4669-8de8-21d2016488fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:11.564915 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2e112378-eac1-4669-8de8-21d2016488fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:11.565687 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2e112378-eac1-4669-8de8-21d2016488fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:11.721448 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2e112378-eac1-4669-8de8-21d2016488fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:11.730777 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2e112378-eac1-4669-8de8-21d2016488fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:11.732526 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2e112378-eac1-4669-8de8-21d2016488fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:11.733889 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2e112378-eac1-4669-8de8-21d2016488fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1740 microversion: 2.20 time: 0.183708 Jun 20 18:55:11.734611 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 479/972] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:11 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:12.444670 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-da033df3-6d45-46c4-8269-9c18888e3837 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:12.445322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-da033df3-6d45-46c4-8269-9c18888e3837 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:12.452303 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-da033df3-6d45-46c4-8269-9c18888e3837 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:12.453083 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-da033df3-6d45-46c4-8269-9c18888e3837 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:12.454074 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-da033df3-6d45-46c4-8269-9c18888e3837 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:12.454722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-da033df3-6d45-46c4-8269-9c18888e3837 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:12.665527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-da033df3-6d45-46c4-8269-9c18888e3837 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:12.679154 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-da033df3-6d45-46c4-8269-9c18888e3837 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1557 microversion: 2.1 time: 0.238985 Jun 20 18:55:12.680273 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 494/973] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:12 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1557 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:12.697084 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-91a8546a-8b8f-4a4c-8bdc-c4ed4dee4a3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:12.698076 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-91a8546a-8b8f-4a4c-8bdc-c4ed4dee4a3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:12.714535 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91a8546a-8b8f-4a4c-8bdc-c4ed4dee4a3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:12.715378 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91a8546a-8b8f-4a4c-8bdc-c4ed4dee4a3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:12.716455 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91a8546a-8b8f-4a4c-8bdc-c4ed4dee4a3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:12.717057 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91a8546a-8b8f-4a4c-8bdc-c4ed4dee4a3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:12.753240 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-50146108-420d-47f4-80f9-6c0824c31a99 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:12.763901 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-50146108-420d-47f4-80f9-6c0824c31a99 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:12.771397 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-50146108-420d-47f4-80f9-6c0824c31a99 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:12.771849 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-50146108-420d-47f4-80f9-6c0824c31a99 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:12.772632 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-50146108-420d-47f4-80f9-6c0824c31a99 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:12.773063 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-50146108-420d-47f4-80f9-6c0824c31a99 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:12.817721 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-91a8546a-8b8f-4a4c-8bdc-c4ed4dee4a3a tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124071 Jun 20 18:55:12.818559 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 480/974] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jun 20 18:55:12 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:55:13.116228 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-50146108-420d-47f4-80f9-6c0824c31a99 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:13.131999 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-50146108-420d-47f4-80f9-6c0824c31a99 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:13.136205 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-50146108-420d-47f4-80f9-6c0824c31a99 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:13.136741 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-50146108-420d-47f4-80f9-6c0824c31a99 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1740 microversion: 2.20 time: 0.387810 Jun 20 18:55:13.137590 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 495/975] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:12 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1740 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:14.155898 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-83a16f7d-53e8-4b7b-8387-df4407876d5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:14.156415 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-83a16f7d-53e8-4b7b-8387-df4407876d5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:14.163697 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-83a16f7d-53e8-4b7b-8387-df4407876d5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:14.168373 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-83a16f7d-53e8-4b7b-8387-df4407876d5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:14.169313 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-83a16f7d-53e8-4b7b-8387-df4407876d5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:14.169819 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-83a16f7d-53e8-4b7b-8387-df4407876d5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:14.269972 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-0a8e9bd2-1431-4a8a-81e2-2c82a566b94c req-6172f104-e46b-4b86-b03a-61f5208f95ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3cd7486-00ce-4ee1-a280-48d2720f8d0a", "tag": "cfb96e54-b9ce-42bf-8b8d-34ef813c73bc"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:55:14.288273 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-0a8e9bd2-1431-4a8a-81e2-2c82a566b94c req-6172f104-e46b-4b86-b03a-61f5208f95ab service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:14.289260 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-0a8e9bd2-1431-4a8a-81e2-2c82a566b94c req-6172f104-e46b-4b86-b03a-61f5208f95ab service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:14.311728 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-0a8e9bd2-1431-4a8a-81e2-2c82a566b94c req-6172f104-e46b-4b86-b03a-61f5208f95ab service nova] Creating event network-changed:cfb96e54-b9ce-42bf-8b8d-34ef813c73bc for instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a on hv-cinder-83697 Jun 20 18:55:14.319025 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-0a8e9bd2-1431-4a8a-81e2-2c82a566b94c req-6172f104-e46b-4b86-b03a-61f5208f95ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052664 Jun 20 18:55:14.320151 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 496/976] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:55:14.411695 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-83a16f7d-53e8-4b7b-8387-df4407876d5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:14.425216 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-83a16f7d-53e8-4b7b-8387-df4407876d5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:14.427062 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-83a16f7d-53e8-4b7b-8387-df4407876d5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:14.428507 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-83a16f7d-53e8-4b7b-8387-df4407876d5f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1740 microversion: 2.20 time: 0.277101 Jun 20 18:55:14.429556 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 481/977] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:14 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:15.451490 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ffb27d3f-5312-4313-ab83-c587f0280958 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:15.452864 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ffb27d3f-5312-4313-ab83-c587f0280958 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:15.464438 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ffb27d3f-5312-4313-ab83-c587f0280958 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:15.464856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ffb27d3f-5312-4313-ab83-c587f0280958 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:15.465653 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ffb27d3f-5312-4313-ab83-c587f0280958 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:15.466096 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ffb27d3f-5312-4313-ab83-c587f0280958 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:15.634440 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ffb27d3f-5312-4313-ab83-c587f0280958 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:15.643480 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ffb27d3f-5312-4313-ab83-c587f0280958 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:15.646863 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ffb27d3f-5312-4313-ab83-c587f0280958 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:15.648401 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ffb27d3f-5312-4313-ab83-c587f0280958 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1740 microversion: 2.20 time: 0.201290 Jun 20 18:55:15.649431 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 497/978] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:15 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:16.667221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-71c9860a-8189-4350-98ad-b67783208746 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:16.667996 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-71c9860a-8189-4350-98ad-b67783208746 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:16.674696 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-71c9860a-8189-4350-98ad-b67783208746 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:16.674964 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-71c9860a-8189-4350-98ad-b67783208746 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:16.675907 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-71c9860a-8189-4350-98ad-b67783208746 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:16.676593 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-71c9860a-8189-4350-98ad-b67783208746 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:16.823012 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-71c9860a-8189-4350-98ad-b67783208746 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:16.831345 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-71c9860a-8189-4350-98ad-b67783208746 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:16.833128 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-71c9860a-8189-4350-98ad-b67783208746 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:16.834278 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-71c9860a-8189-4350-98ad-b67783208746 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1740 microversion: 2.20 time: 0.171475 Jun 20 18:55:16.836242 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 482/979] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:16 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:17.853619 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6cba43f9-117d-4db8-83d7-0b5546c74062 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:17.854274 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6cba43f9-117d-4db8-83d7-0b5546c74062 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:17.860603 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6cba43f9-117d-4db8-83d7-0b5546c74062 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:17.861376 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6cba43f9-117d-4db8-83d7-0b5546c74062 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:17.862364 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6cba43f9-117d-4db8-83d7-0b5546c74062 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:17.863248 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6cba43f9-117d-4db8-83d7-0b5546c74062 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:18.007906 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6cba43f9-117d-4db8-83d7-0b5546c74062 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:18.017900 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6cba43f9-117d-4db8-83d7-0b5546c74062 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:18.019418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6cba43f9-117d-4db8-83d7-0b5546c74062 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:18.021630 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6cba43f9-117d-4db8-83d7-0b5546c74062 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1740 microversion: 2.20 time: 0.172290 Jun 20 18:55:18.022183 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 498/980] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:17 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:19.041206 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-413ba94f-d886-4421-8881-2c01d482947c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:19.042391 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-413ba94f-d886-4421-8881-2c01d482947c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:19.049222 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-413ba94f-d886-4421-8881-2c01d482947c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:19.050064 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-413ba94f-d886-4421-8881-2c01d482947c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:19.051576 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-413ba94f-d886-4421-8881-2c01d482947c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:19.052178 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-413ba94f-d886-4421-8881-2c01d482947c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:19.236498 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-413ba94f-d886-4421-8881-2c01d482947c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:19.247096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-413ba94f-d886-4421-8881-2c01d482947c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:19.249096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-413ba94f-d886-4421-8881-2c01d482947c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:19.250873 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-413ba94f-d886-4421-8881-2c01d482947c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1740 microversion: 2.20 time: 0.213663 Jun 20 18:55:19.251581 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 483/981] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:19 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:20.268505 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7b188b97-7368-4324-b402-ff8551668827 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:20.270583 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7b188b97-7368-4324-b402-ff8551668827 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:20.278330 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7b188b97-7368-4324-b402-ff8551668827 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:20.279060 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7b188b97-7368-4324-b402-ff8551668827 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:20.280006 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7b188b97-7368-4324-b402-ff8551668827 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:20.280433 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7b188b97-7368-4324-b402-ff8551668827 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:20.427496 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7b188b97-7368-4324-b402-ff8551668827 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:20.436285 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7b188b97-7368-4324-b402-ff8551668827 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:20.437805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7b188b97-7368-4324-b402-ff8551668827 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:20.439051 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7b188b97-7368-4324-b402-ff8551668827 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1740 microversion: 2.20 time: 0.174566 Jun 20 18:55:20.439665 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 499/982] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:20 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:21.458304 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-108d3977-11d7-4bf6-a57f-74fa34d879e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:21.458853 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-108d3977-11d7-4bf6-a57f-74fa34d879e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:21.465098 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-108d3977-11d7-4bf6-a57f-74fa34d879e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:21.465541 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-108d3977-11d7-4bf6-a57f-74fa34d879e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:21.466307 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-108d3977-11d7-4bf6-a57f-74fa34d879e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:21.466790 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-108d3977-11d7-4bf6-a57f-74fa34d879e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:21.776878 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-108d3977-11d7-4bf6-a57f-74fa34d879e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:21.785032 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-108d3977-11d7-4bf6-a57f-74fa34d879e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:21.787272 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-108d3977-11d7-4bf6-a57f-74fa34d879e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:21.788584 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-108d3977-11d7-4bf6-a57f-74fa34d879e5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1722 microversion: 2.20 time: 0.334809 Jun 20 18:55:21.789416 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 484/983] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:21 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:22.806860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1a9267f3-2724-466c-9780-366b097f5489 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:22.807495 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1a9267f3-2724-466c-9780-366b097f5489 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:22.813929 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1a9267f3-2724-466c-9780-366b097f5489 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:22.814378 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1a9267f3-2724-466c-9780-366b097f5489 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:22.815161 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1a9267f3-2724-466c-9780-366b097f5489 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:22.815588 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1a9267f3-2724-466c-9780-366b097f5489 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:22.946517 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1a9267f3-2724-466c-9780-366b097f5489 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:22.955578 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1a9267f3-2724-466c-9780-366b097f5489 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:22.957127 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1a9267f3-2724-466c-9780-366b097f5489 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:22.958279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1a9267f3-2724-466c-9780-366b097f5489 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1722 microversion: 2.20 time: 0.155256 Jun 20 18:55:22.958834 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 500/984] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:22 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:23.977069 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e171d16a-abe9-4f82-98d4-fa338bebe9a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:23.977788 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e171d16a-abe9-4f82-98d4-fa338bebe9a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:23.984902 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e171d16a-abe9-4f82-98d4-fa338bebe9a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:23.985431 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e171d16a-abe9-4f82-98d4-fa338bebe9a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:23.986240 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e171d16a-abe9-4f82-98d4-fa338bebe9a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:23.986781 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e171d16a-abe9-4f82-98d4-fa338bebe9a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:24.158747 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e171d16a-abe9-4f82-98d4-fa338bebe9a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:24.168284 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e171d16a-abe9-4f82-98d4-fa338bebe9a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:24.170031 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e171d16a-abe9-4f82-98d4-fa338bebe9a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:24.171417 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e171d16a-abe9-4f82-98d4-fa338bebe9a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1725 microversion: 2.20 time: 0.198918 Jun 20 18:55:24.172138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 485/985] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:23 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:24.190783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a6c31f6a-4f90-4662-97c4-ce0950b28ad1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a25b1a47-b1c3-49b0-a574-3af4eea79e46"}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:55:24.192027 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a6c31f6a-4f90-4662-97c4-ce0950b28ad1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:24.198899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a6c31f6a-4f90-4662-97c4-ce0950b28ad1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:24.199370 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a6c31f6a-4f90-4662-97c4-ce0950b28ad1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:24.200133 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a6c31f6a-4f90-4662-97c4-ce0950b28ad1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:24.200587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a6c31f6a-4f90-4662-97c4-ce0950b28ad1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:24.367204 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-39ea2723-236f-47fc-a073-29a033b881f1 req-ce8fa450-d73d-4dd8-bf90-98fdf1ce860b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb97000-4705-4f02-bdd0-00047a203abf", "name": "network-vif-unplugged", "status": "completed", "tag": "d20d672a-4e79-42b8-b764-55a554f24b8b"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:55:24.376108 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-39ea2723-236f-47fc-a073-29a033b881f1 req-ce8fa450-d73d-4dd8-bf90-98fdf1ce860b service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:24.376963 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-39ea2723-236f-47fc-a073-29a033b881f1 req-ce8fa450-d73d-4dd8-bf90-98fdf1ce860b service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:24.389439 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.compute.server_external_events [req-39ea2723-236f-47fc-a073-29a033b881f1 req-ce8fa450-d73d-4dd8-bf90-98fdf1ce860b service nova] Unable to find a host for instance dcb97000-4705-4f02-bdd0-00047a203abf. Dropping event network-vif-unplugged {{(pid=124190) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 18:55:24.390405 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-39ea2723-236f-47fc-a073-29a033b881f1 req-ce8fa450-d73d-4dd8-bf90-98fdf1ce860b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027975 Jun 20 18:55:24.391106 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 486/986] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 20 18:55:24.487948 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a6c31f6a-4f90-4662-97c4-ce0950b28ad1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "POST /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.301173 Jun 20 18:55:24.488571 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 501/987] 10.222.0.43 () {62 vars in 1363 bytes} [Mon Jun 20 18:55:24 2022] POST /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 18:55:24.602072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1b54ce4a-561e-4d36-98bc-badc740ba74c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:24.602800 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1b54ce4a-561e-4d36-98bc-badc740ba74c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:24.609082 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1b54ce4a-561e-4d36-98bc-badc740ba74c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:24.609549 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1b54ce4a-561e-4d36-98bc-badc740ba74c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:24.610290 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1b54ce4a-561e-4d36-98bc-badc740ba74c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:24.610725 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1b54ce4a-561e-4d36-98bc-badc740ba74c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:24.835835 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1b54ce4a-561e-4d36-98bc-badc740ba74c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf/os-volume_attachments/a25b1a47-b1c3-49b0-a574-3af4eea79e46" status: 202 len: 0 microversion: 2.20 time: 0.239048 Jun 20 18:55:24.836423 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 487/988] 10.222.0.43 () {60 vars in 1456 bytes} [Mon Jun 20 18:55:24 2022] DELETE /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf/os-volume_attachments/a25b1a47-b1c3-49b0-a574-3af4eea79e46 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:55:24.890790 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-094e6d84-9d61-4813-92c4-ed9329f571a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:55:24.891418 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-094e6d84-9d61-4813-92c4-ed9329f571a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:24.898049 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-094e6d84-9d61-4813-92c4-ed9329f571a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:24.898498 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-094e6d84-9d61-4813-92c4-ed9329f571a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:24.899294 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-094e6d84-9d61-4813-92c4-ed9329f571a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:24.899733 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-094e6d84-9d61-4813-92c4-ed9329f571a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:24.916549 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:24.993249 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-094e6d84-9d61-4813-92c4-ed9329f571a0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "POST /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf/action" status: 202 len: 0 microversion: 2.20 time: 0.106427 Jun 20 18:55:24.993950 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 502/989] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Jun 20 18:55:24 2022] POST /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:55:25.002073 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ce366575-b8bb-4ce7-906b-821d37768220 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:25.002859 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ce366575-b8bb-4ce7-906b-821d37768220 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:25.009869 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce366575-b8bb-4ce7-906b-821d37768220 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:25.010533 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce366575-b8bb-4ce7-906b-821d37768220 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:25.011407 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce366575-b8bb-4ce7-906b-821d37768220 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:25.011832 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce366575-b8bb-4ce7-906b-821d37768220 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:25.172763 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ce366575-b8bb-4ce7-906b-821d37768220 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:25.182065 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ce366575-b8bb-4ce7-906b-821d37768220 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:25.183585 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ce366575-b8bb-4ce7-906b-821d37768220 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:25.184886 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ce366575-b8bb-4ce7-906b-821d37768220 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1673 microversion: 2.20 time: 0.186871 Jun 20 18:55:25.185426 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 488/990] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:24 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:26.204127 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-468de0d1-6bf2-48c5-88a8-8d9307d7a98f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:26.204727 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-468de0d1-6bf2-48c5-88a8-8d9307d7a98f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:26.212523 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-468de0d1-6bf2-48c5-88a8-8d9307d7a98f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:26.213085 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-468de0d1-6bf2-48c5-88a8-8d9307d7a98f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:26.213898 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-468de0d1-6bf2-48c5-88a8-8d9307d7a98f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:26.214275 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-468de0d1-6bf2-48c5-88a8-8d9307d7a98f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:26.779407 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-468de0d1-6bf2-48c5-88a8-8d9307d7a98f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:26.787937 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-468de0d1-6bf2-48c5-88a8-8d9307d7a98f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:26.789700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-468de0d1-6bf2-48c5-88a8-8d9307d7a98f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:26.790871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-468de0d1-6bf2-48c5-88a8-8d9307d7a98f tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.591134 Jun 20 18:55:26.796227 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 503/991] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:26 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:27.581294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-743d191c-62f2-4d9f-8bdb-9c864d2195fc tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:27.581794 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-743d191c-62f2-4d9f-8bdb-9c864d2195fc tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:27.590534 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-fb1c7f9f-ebfc-4f39-a015-a50d82ad5254 req-3e4ae828-802b-42ae-88ee-03968c3cca6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85165412-e44c-453d-aa22-d248bff1a459", "tag": "12fa4b8e-1393-46da-afb1-ff594d0231e6"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:55:27.597036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-743d191c-62f2-4d9f-8bdb-9c864d2195fc tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:27.597507 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-743d191c-62f2-4d9f-8bdb-9c864d2195fc tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:27.603967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-743d191c-62f2-4d9f-8bdb-9c864d2195fc tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:27.604607 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-743d191c-62f2-4d9f-8bdb-9c864d2195fc tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:27.605186 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-fb1c7f9f-ebfc-4f39-a015-a50d82ad5254 req-3e4ae828-802b-42ae-88ee-03968c3cca6e service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:27.605629 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-fb1c7f9f-ebfc-4f39-a015-a50d82ad5254 req-3e4ae828-802b-42ae-88ee-03968c3cca6e service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:27.640265 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-fb1c7f9f-ebfc-4f39-a015-a50d82ad5254 req-3e4ae828-802b-42ae-88ee-03968c3cca6e service nova] Creating event network-changed:12fa4b8e-1393-46da-afb1-ff594d0231e6 for instance 85165412-e44c-453d-aa22-d248bff1a459 on hv-cinder-83697 Jun 20 18:55:27.653547 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-fb1c7f9f-ebfc-4f39-a015-a50d82ad5254 req-3e4ae828-802b-42ae-88ee-03968c3cca6e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065390 Jun 20 18:55:27.654448 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 504/992] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:55:27.656953 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-743d191c-62f2-4d9f-8bdb-9c864d2195fc tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:55:27.811244 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-743d191c-62f2-4d9f-8bdb-9c864d2195fc tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "DELETE /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 204 len: 0 microversion: 2.1 time: 0.233838 Jun 20 18:55:27.812175 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 489/993] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:55:27 2022] DELETE /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:55:27.812291 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-49a7bdf7-c2ba-4286-84ea-66817c7215ba tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:27.813129 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-49a7bdf7-c2ba-4286-84ea-66817c7215ba tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:27.821426 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-49a7bdf7-c2ba-4286-84ea-66817c7215ba tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:27.825116 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-705a5280-5106-49e3-89ce-3649d64f1d9d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:27.825831 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-705a5280-5106-49e3-89ce-3649d64f1d9d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:27.826625 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-49a7bdf7-c2ba-4286-84ea-66817c7215ba tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:27.828017 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-49a7bdf7-c2ba-4286-84ea-66817c7215ba tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:27.828880 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-49a7bdf7-c2ba-4286-84ea-66817c7215ba tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:27.836565 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-705a5280-5106-49e3-89ce-3649d64f1d9d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:27.837277 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-705a5280-5106-49e3-89ce-3649d64f1d9d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:27.838471 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-705a5280-5106-49e3-89ce-3649d64f1d9d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:27.839109 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-705a5280-5106-49e3-89ce-3649d64f1d9d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:28.060262 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-49a7bdf7-c2ba-4286-84ea-66817c7215ba tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:28.070259 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-49a7bdf7-c2ba-4286-84ea-66817c7215ba tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:28.071783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-49a7bdf7-c2ba-4286-84ea-66817c7215ba tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:28.077258 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-49a7bdf7-c2ba-4286-84ea-66817c7215ba tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.270727 Jun 20 18:55:28.079491 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 505/994] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:27 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:28.091384 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-705a5280-5106-49e3-89ce-3649d64f1d9d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:28.099187 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-705a5280-5106-49e3-89ce-3649d64f1d9d tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.281862 Jun 20 18:55:28.100359 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 490/995] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:27 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:29.096272 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d43f2a40-9b10-4f0c-87f0-f0f3dac1b074 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:29.098318 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d43f2a40-9b10-4f0c-87f0-f0f3dac1b074 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:29.106030 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d43f2a40-9b10-4f0c-87f0-f0f3dac1b074 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:29.107003 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d43f2a40-9b10-4f0c-87f0-f0f3dac1b074 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:29.108244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d43f2a40-9b10-4f0c-87f0-f0f3dac1b074 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:29.108863 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d43f2a40-9b10-4f0c-87f0-f0f3dac1b074 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:29.120335 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9edb7ec5-af48-4d15-b6f2-34d8db14bbd2 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:29.121092 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9edb7ec5-af48-4d15-b6f2-34d8db14bbd2 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:29.128348 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9edb7ec5-af48-4d15-b6f2-34d8db14bbd2 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:29.128994 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9edb7ec5-af48-4d15-b6f2-34d8db14bbd2 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:29.139825 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9edb7ec5-af48-4d15-b6f2-34d8db14bbd2 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:29.140761 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9edb7ec5-af48-4d15-b6f2-34d8db14bbd2 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:29.323275 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9edb7ec5-af48-4d15-b6f2-34d8db14bbd2 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:29.330583 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d43f2a40-9b10-4f0c-87f0-f0f3dac1b074 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:29.330976 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9edb7ec5-af48-4d15-b6f2-34d8db14bbd2 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.216725 Jun 20 18:55:29.332876 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 491/996] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:29 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:29.340228 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d43f2a40-9b10-4f0c-87f0-f0f3dac1b074 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:29.343683 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d43f2a40-9b10-4f0c-87f0-f0f3dac1b074 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:29.344982 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d43f2a40-9b10-4f0c-87f0-f0f3dac1b074 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.253056 Jun 20 18:55:29.345616 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 506/997] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:29 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:30.349915 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2f783d8b-12b1-43f9-b6fe-3d44e548d804 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:30.350552 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2f783d8b-12b1-43f9-b6fe-3d44e548d804 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:30.357238 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2f783d8b-12b1-43f9-b6fe-3d44e548d804 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:30.357751 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2f783d8b-12b1-43f9-b6fe-3d44e548d804 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:30.360154 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2f783d8b-12b1-43f9-b6fe-3d44e548d804 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:30.360601 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2f783d8b-12b1-43f9-b6fe-3d44e548d804 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:30.362839 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-2e402ab0-d5fc-426a-85b7-73cc2435fda4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:30.363983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-2e402ab0-d5fc-426a-85b7-73cc2435fda4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:30.370113 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2e402ab0-d5fc-426a-85b7-73cc2435fda4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:30.370567 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2e402ab0-d5fc-426a-85b7-73cc2435fda4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:30.371354 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2e402ab0-d5fc-426a-85b7-73cc2435fda4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:30.371987 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2e402ab0-d5fc-426a-85b7-73cc2435fda4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:30.377705 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:30.523204 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2f783d8b-12b1-43f9-b6fe-3d44e548d804 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:30.538452 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2f783d8b-12b1-43f9-b6fe-3d44e548d804 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.192931 Jun 20 18:55:30.539919 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 492/998] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:30 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:30.555851 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-2e402ab0-d5fc-426a-85b7-73cc2435fda4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:30.564912 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-2e402ab0-d5fc-426a-85b7-73cc2435fda4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:30.566611 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-2e402ab0-d5fc-426a-85b7-73cc2435fda4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:30.567824 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-2e402ab0-d5fc-426a-85b7-73cc2435fda4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.208851 Jun 20 18:55:30.568380 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 507/999] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:30 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:31.556915 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d3d26ed4-d5cc-4dfc-915f-d3ef2ada45fa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:31.557438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d3d26ed4-d5cc-4dfc-915f-d3ef2ada45fa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:31.563866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d3d26ed4-d5cc-4dfc-915f-d3ef2ada45fa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:31.564311 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d3d26ed4-d5cc-4dfc-915f-d3ef2ada45fa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:31.565077 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d3d26ed4-d5cc-4dfc-915f-d3ef2ada45fa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:31.565508 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d3d26ed4-d5cc-4dfc-915f-d3ef2ada45fa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:31.585692 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1f948240-1b8e-40fb-95a7-a10afb0c9e87 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:31.586955 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1f948240-1b8e-40fb-95a7-a10afb0c9e87 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:31.593762 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1f948240-1b8e-40fb-95a7-a10afb0c9e87 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:31.594215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1f948240-1b8e-40fb-95a7-a10afb0c9e87 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:31.595010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1f948240-1b8e-40fb-95a7-a10afb0c9e87 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:31.595645 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1f948240-1b8e-40fb-95a7-a10afb0c9e87 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:31.745725 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d3d26ed4-d5cc-4dfc-915f-d3ef2ada45fa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:31.762566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1f948240-1b8e-40fb-95a7-a10afb0c9e87 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:31.770934 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d3d26ed4-d5cc-4dfc-915f-d3ef2ada45fa tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.217826 Jun 20 18:55:31.771862 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 493/1000] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:31 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:31.777457 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1f948240-1b8e-40fb-95a7-a10afb0c9e87 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:31.779270 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1f948240-1b8e-40fb-95a7-a10afb0c9e87 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:31.780514 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1f948240-1b8e-40fb-95a7-a10afb0c9e87 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.198866 Jun 20 18:55:31.781139 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 508/1001] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:31 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:55:32.789591 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5382c2f8-fce1-4730-84cc-6e86f9d62ff1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:32.790210 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5382c2f8-fce1-4730-84cc-6e86f9d62ff1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:32.798931 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5382c2f8-fce1-4730-84cc-6e86f9d62ff1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:32.799390 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5382c2f8-fce1-4730-84cc-6e86f9d62ff1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:32.800174 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5382c2f8-fce1-4730-84cc-6e86f9d62ff1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:32.800709 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5382c2f8-fce1-4730-84cc-6e86f9d62ff1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:32.800852 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d4066c29-ffc6-4e4a-88e2-08066627ffa3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:32.801368 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d4066c29-ffc6-4e4a-88e2-08066627ffa3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:32.810785 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d4066c29-ffc6-4e4a-88e2-08066627ffa3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:32.812489 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d4066c29-ffc6-4e4a-88e2-08066627ffa3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:32.813726 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d4066c29-ffc6-4e4a-88e2-08066627ffa3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:32.814497 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d4066c29-ffc6-4e4a-88e2-08066627ffa3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:32.958159 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5382c2f8-fce1-4730-84cc-6e86f9d62ff1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:32.972231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5382c2f8-fce1-4730-84cc-6e86f9d62ff1 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.187320 Jun 20 18:55:32.974233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 494/1002] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:32 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:32.986007 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d4066c29-ffc6-4e4a-88e2-08066627ffa3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:32.994681 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d4066c29-ffc6-4e4a-88e2-08066627ffa3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:32.997133 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d4066c29-ffc6-4e4a-88e2-08066627ffa3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:32.998627 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d4066c29-ffc6-4e4a-88e2-08066627ffa3 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.201685 Jun 20 18:55:32.999796 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 509/1003] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:32 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:55:33.991801 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b5522c01-c9f1-4e44-9887-242ccde274c8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:33.992411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b5522c01-c9f1-4e44-9887-242ccde274c8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:33.994764 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:33.999994 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b5522c01-c9f1-4e44-9887-242ccde274c8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:34.000441 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b5522c01-c9f1-4e44-9887-242ccde274c8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:34.001190 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b5522c01-c9f1-4e44-9887-242ccde274c8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:34.001621 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b5522c01-c9f1-4e44-9887-242ccde274c8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:34.020648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a8efcaff-d0d9-415f-a51f-5bb744239b64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:34.022016 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a8efcaff-d0d9-415f-a51f-5bb744239b64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:34.024538 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=52 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:34.029728 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a8efcaff-d0d9-415f-a51f-5bb744239b64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:34.030476 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a8efcaff-d0d9-415f-a51f-5bb744239b64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:34.031595 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a8efcaff-d0d9-415f-a51f-5bb744239b64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:34.032238 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a8efcaff-d0d9-415f-a51f-5bb744239b64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:34.170442 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b5522c01-c9f1-4e44-9887-242ccde274c8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:34.179760 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b5522c01-c9f1-4e44-9887-242ccde274c8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.191765 Jun 20 18:55:34.181034 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 495/1004] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:33 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:34.210181 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a8efcaff-d0d9-415f-a51f-5bb744239b64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:34.219189 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a8efcaff-d0d9-415f-a51f-5bb744239b64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:34.220804 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a8efcaff-d0d9-415f-a51f-5bb744239b64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:34.221989 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a8efcaff-d0d9-415f-a51f-5bb744239b64 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.205924 Jun 20 18:55:34.222870 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 510/1005] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:34 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:35.197382 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9f4f6d30-d4fb-4797-bed6-37156c6784ac tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:35.198106 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9f4f6d30-d4fb-4797-bed6-37156c6784ac tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:35.205155 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9f4f6d30-d4fb-4797-bed6-37156c6784ac tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:35.205698 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9f4f6d30-d4fb-4797-bed6-37156c6784ac tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:35.206568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9f4f6d30-d4fb-4797-bed6-37156c6784ac tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:35.207697 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9f4f6d30-d4fb-4797-bed6-37156c6784ac tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:35.245833 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7a13a16d-cdda-44fe-82aa-2895d0aebc76 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:35.246443 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7a13a16d-cdda-44fe-82aa-2895d0aebc76 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:35.254117 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7a13a16d-cdda-44fe-82aa-2895d0aebc76 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:35.254713 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7a13a16d-cdda-44fe-82aa-2895d0aebc76 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:35.255648 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7a13a16d-cdda-44fe-82aa-2895d0aebc76 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:35.256082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7a13a16d-cdda-44fe-82aa-2895d0aebc76 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:35.362252 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9f4f6d30-d4fb-4797-bed6-37156c6784ac tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:35.373171 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9f4f6d30-d4fb-4797-bed6-37156c6784ac tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.179653 Jun 20 18:55:35.383170 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 496/1006] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:35 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:35.414907 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7a13a16d-cdda-44fe-82aa-2895d0aebc76 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:35.426040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7a13a16d-cdda-44fe-82aa-2895d0aebc76 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:35.427732 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-7a13a16d-cdda-44fe-82aa-2895d0aebc76 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:35.428883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7a13a16d-cdda-44fe-82aa-2895d0aebc76 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.186931 Jun 20 18:55:35.429482 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 511/1007] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:35 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:36.391834 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9d299d3a-e94a-4d06-93ce-2f3402d5231b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:36.392433 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9d299d3a-e94a-4d06-93ce-2f3402d5231b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:36.399137 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9d299d3a-e94a-4d06-93ce-2f3402d5231b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:36.399943 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9d299d3a-e94a-4d06-93ce-2f3402d5231b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:36.400719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9d299d3a-e94a-4d06-93ce-2f3402d5231b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:36.401379 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9d299d3a-e94a-4d06-93ce-2f3402d5231b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:36.449506 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d960ceaf-7b12-4543-89d4-b268ef59dbf4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:36.451033 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d960ceaf-7b12-4543-89d4-b268ef59dbf4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:36.458112 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d960ceaf-7b12-4543-89d4-b268ef59dbf4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:36.458793 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d960ceaf-7b12-4543-89d4-b268ef59dbf4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:36.459656 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d960ceaf-7b12-4543-89d4-b268ef59dbf4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:36.460152 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d960ceaf-7b12-4543-89d4-b268ef59dbf4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:36.562792 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9d299d3a-e94a-4d06-93ce-2f3402d5231b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:36.572503 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9d299d3a-e94a-4d06-93ce-2f3402d5231b tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.185058 Jun 20 18:55:36.579781 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 497/1008] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:36 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:36.641241 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d960ceaf-7b12-4543-89d4-b268ef59dbf4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:36.650218 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d960ceaf-7b12-4543-89d4-b268ef59dbf4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:36.651665 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d960ceaf-7b12-4543-89d4-b268ef59dbf4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:36.652816 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d960ceaf-7b12-4543-89d4-b268ef59dbf4 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.208104 Jun 20 18:55:36.653369 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 512/1009] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:36 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:36.782802 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2085b74c-0272-4306-a858-55bd383ad6ba tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:36.783318 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2085b74c-0272-4306-a858-55bd383ad6ba tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:36.790767 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2085b74c-0272-4306-a858-55bd383ad6ba tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:36.791377 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2085b74c-0272-4306-a858-55bd383ad6ba tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:36.792143 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2085b74c-0272-4306-a858-55bd383ad6ba tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:36.792708 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2085b74c-0272-4306-a858-55bd383ad6ba tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:36.817745 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2085b74c-0272-4306-a858-55bd383ad6ba tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/ips" status: 200 len: 146 microversion: 2.1 time: 0.038768 Jun 20 18:55:36.823734 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 498/1010] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jun 20 18:55:36 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:55:37.590566 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ed83344e-46c5-4929-bbd2-8558ddfed834 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:37.591308 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ed83344e-46c5-4929-bbd2-8558ddfed834 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:37.598388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed83344e-46c5-4929-bbd2-8558ddfed834 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:37.598842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed83344e-46c5-4929-bbd2-8558ddfed834 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:37.599630 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed83344e-46c5-4929-bbd2-8558ddfed834 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:37.600059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ed83344e-46c5-4929-bbd2-8558ddfed834 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:37.671912 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7c0b3121-e44f-4846-9faf-7222539b3ae5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:37.672661 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7c0b3121-e44f-4846-9faf-7222539b3ae5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:37.683591 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c0b3121-e44f-4846-9faf-7222539b3ae5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:37.687487 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c0b3121-e44f-4846-9faf-7222539b3ae5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:37.688179 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c0b3121-e44f-4846-9faf-7222539b3ae5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:37.688943 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c0b3121-e44f-4846-9faf-7222539b3ae5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:37.767580 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ed83344e-46c5-4929-bbd2-8558ddfed834 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:37.779325 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ed83344e-46c5-4929-bbd2-8558ddfed834 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.192839 Jun 20 18:55:37.780505 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 513/1011] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:37 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:37.851829 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7c0b3121-e44f-4846-9faf-7222539b3ae5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:37.859911 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7c0b3121-e44f-4846-9faf-7222539b3ae5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:37.861453 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7c0b3121-e44f-4846-9faf-7222539b3ae5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:37.863356 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7c0b3121-e44f-4846-9faf-7222539b3ae5 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.195713 Jun 20 18:55:37.863923 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 499/1012] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:37 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:38.166020 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1a84fcc8-b959-492a-a003-edc1e2b9b0be tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b654646-6b79-49c0-bbc3-379410da2bf4"}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:55:38.167405 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1a84fcc8-b959-492a-a003-edc1e2b9b0be tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:38.173835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1a84fcc8-b959-492a-a003-edc1e2b9b0be tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:38.174287 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1a84fcc8-b959-492a-a003-edc1e2b9b0be tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:38.175090 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1a84fcc8-b959-492a-a003-edc1e2b9b0be tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:38.176051 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1a84fcc8-b959-492a-a003-edc1e2b9b0be tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:38.796811 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c9b971b0-05b6-4037-b836-1d0e47bebd14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:38.797411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c9b971b0-05b6-4037-b836-1d0e47bebd14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:38.803982 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c9b971b0-05b6-4037-b836-1d0e47bebd14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:38.804511 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c9b971b0-05b6-4037-b836-1d0e47bebd14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:38.805299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c9b971b0-05b6-4037-b836-1d0e47bebd14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:38.805739 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c9b971b0-05b6-4037-b836-1d0e47bebd14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:38.939967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c9b971b0-05b6-4037-b836-1d0e47bebd14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:38.948286 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c9b971b0-05b6-4037-b836-1d0e47bebd14 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.155362 Jun 20 18:55:38.948875 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 500/1013] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:38 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:55:38.953482 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d9802f02-780d-4aa2-b83d-ee890ecbb942 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:38.954109 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d9802f02-780d-4aa2-b83d-ee890ecbb942 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:38.960484 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d9802f02-780d-4aa2-b83d-ee890ecbb942 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:38.960936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d9802f02-780d-4aa2-b83d-ee890ecbb942 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:38.961756 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d9802f02-780d-4aa2-b83d-ee890ecbb942 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:38.962197 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d9802f02-780d-4aa2-b83d-ee890ecbb942 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:39.100131 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d9802f02-780d-4aa2-b83d-ee890ecbb942 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:39.108315 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d9802f02-780d-4aa2-b83d-ee890ecbb942 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:39.109831 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d9802f02-780d-4aa2-b83d-ee890ecbb942 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:39.111073 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d9802f02-780d-4aa2-b83d-ee890ecbb942 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.161242 Jun 20 18:55:39.111658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 501/1014] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:38 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:39.965732 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-6b3dbc07-f4e4-403a-b7f9-dcfbf9d9045a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:39.966416 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-6b3dbc07-f4e4-403a-b7f9-dcfbf9d9045a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:39.973323 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6b3dbc07-f4e4-403a-b7f9-dcfbf9d9045a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:39.973763 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6b3dbc07-f4e4-403a-b7f9-dcfbf9d9045a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:39.974512 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6b3dbc07-f4e4-403a-b7f9-dcfbf9d9045a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:39.974964 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-6b3dbc07-f4e4-403a-b7f9-dcfbf9d9045a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:40.103819 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-6b3dbc07-f4e4-403a-b7f9-dcfbf9d9045a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:40.111231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-6b3dbc07-f4e4-403a-b7f9-dcfbf9d9045a tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.149294 Jun 20 18:55:40.111786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 502/1015] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:39 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:55:40.129111 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-3583677e-a0f9-4895-b43a-58b7a1e72129 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:40.129791 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-3583677e-a0f9-4895-b43a-58b7a1e72129 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:40.136043 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3583677e-a0f9-4895-b43a-58b7a1e72129 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:40.136301 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3583677e-a0f9-4895-b43a-58b7a1e72129 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:40.137108 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3583677e-a0f9-4895-b43a-58b7a1e72129 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:40.137538 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3583677e-a0f9-4895-b43a-58b7a1e72129 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:40.268343 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-3583677e-a0f9-4895-b43a-58b7a1e72129 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:40.276851 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-3583677e-a0f9-4895-b43a-58b7a1e72129 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:40.278468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-3583677e-a0f9-4895-b43a-58b7a1e72129 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:40.279832 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-3583677e-a0f9-4895-b43a-58b7a1e72129 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.154298 Jun 20 18:55:40.280420 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 503/1016] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:40 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:55:41.127421 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5e84f89b-248d-4e4e-967d-2b5ab3f74eb8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:41.128014 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5e84f89b-248d-4e4e-967d-2b5ab3f74eb8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:41.135026 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5e84f89b-248d-4e4e-967d-2b5ab3f74eb8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:41.135476 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5e84f89b-248d-4e4e-967d-2b5ab3f74eb8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:41.136234 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5e84f89b-248d-4e4e-967d-2b5ab3f74eb8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:41.136670 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5e84f89b-248d-4e4e-967d-2b5ab3f74eb8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:41.270140 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5e84f89b-248d-4e4e-967d-2b5ab3f74eb8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:41.277619 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5e84f89b-248d-4e4e-967d-2b5ab3f74eb8 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.154129 Jun 20 18:55:41.278166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 504/1017] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:41 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:55:41.297499 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c355fcd5-dbfe-4291-aed9-f3288d4e4ced tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:41.298133 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c355fcd5-dbfe-4291-aed9-f3288d4e4ced tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:41.304423 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c355fcd5-dbfe-4291-aed9-f3288d4e4ced tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:41.304869 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c355fcd5-dbfe-4291-aed9-f3288d4e4ced tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:41.305632 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c355fcd5-dbfe-4291-aed9-f3288d4e4ced tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:41.306064 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c355fcd5-dbfe-4291-aed9-f3288d4e4ced tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:41.434804 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c355fcd5-dbfe-4291-aed9-f3288d4e4ced tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:41.442615 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c355fcd5-dbfe-4291-aed9-f3288d4e4ced tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:41.444298 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c355fcd5-dbfe-4291-aed9-f3288d4e4ced tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:41.445519 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c355fcd5-dbfe-4291-aed9-f3288d4e4ced tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.151589 Jun 20 18:55:41.446072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 505/1018] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:41 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:55:42.294694 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-960a3548-95cf-412f-b0a1-a22e2ec0541e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:42.295395 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-960a3548-95cf-412f-b0a1-a22e2ec0541e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:42.301723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-960a3548-95cf-412f-b0a1-a22e2ec0541e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:42.302165 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-960a3548-95cf-412f-b0a1-a22e2ec0541e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:42.302928 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-960a3548-95cf-412f-b0a1-a22e2ec0541e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:42.303364 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-960a3548-95cf-412f-b0a1-a22e2ec0541e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:42.431707 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-960a3548-95cf-412f-b0a1-a22e2ec0541e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:42.439129 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-960a3548-95cf-412f-b0a1-a22e2ec0541e tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.148274 Jun 20 18:55:42.439681 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 506/1019] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:42 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:55:42.462933 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c55883cb-d9bf-47b3-8234-2f2d12001d95 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:42.463578 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c55883cb-d9bf-47b3-8234-2f2d12001d95 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:42.469965 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c55883cb-d9bf-47b3-8234-2f2d12001d95 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:42.470401 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c55883cb-d9bf-47b3-8234-2f2d12001d95 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:42.471199 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c55883cb-d9bf-47b3-8234-2f2d12001d95 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:42.471629 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c55883cb-d9bf-47b3-8234-2f2d12001d95 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:42.596870 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c55883cb-d9bf-47b3-8234-2f2d12001d95 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:42.604698 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c55883cb-d9bf-47b3-8234-2f2d12001d95 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:42.606190 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c55883cb-d9bf-47b3-8234-2f2d12001d95 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:42.607363 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c55883cb-d9bf-47b3-8234-2f2d12001d95 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.148285 Jun 20 18:55:42.607912 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 507/1020] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:42 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:55:43.456196 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-214b6ca7-2c07-4dcc-a2b5-0a073c9a92bb tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:43.456848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-214b6ca7-2c07-4dcc-a2b5-0a073c9a92bb tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:43.463361 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-214b6ca7-2c07-4dcc-a2b5-0a073c9a92bb tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:43.463812 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-214b6ca7-2c07-4dcc-a2b5-0a073c9a92bb tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:43.464572 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-214b6ca7-2c07-4dcc-a2b5-0a073c9a92bb tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:43.465004 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-214b6ca7-2c07-4dcc-a2b5-0a073c9a92bb tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:43.598380 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-214b6ca7-2c07-4dcc-a2b5-0a073c9a92bb tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:43.605813 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-214b6ca7-2c07-4dcc-a2b5-0a073c9a92bb tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1566 microversion: 2.1 time: 0.153506 Jun 20 18:55:43.606398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 508/1021] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:43 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:55:43.624926 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-de49b452-58ae-4c64-9157-3bb80ecd3af0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:43.625525 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-de49b452-58ae-4c64-9157-3bb80ecd3af0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:43.631212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de49b452-58ae-4c64-9157-3bb80ecd3af0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:43.631662 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de49b452-58ae-4c64-9157-3bb80ecd3af0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:43.632418 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de49b452-58ae-4c64-9157-3bb80ecd3af0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:43.632852 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-de49b452-58ae-4c64-9157-3bb80ecd3af0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:43.647123 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=100 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:43.763499 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-de49b452-58ae-4c64-9157-3bb80ecd3af0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:43.771228 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-de49b452-58ae-4c64-9157-3bb80ecd3af0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:43.772719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-de49b452-58ae-4c64-9157-3bb80ecd3af0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:43.773858 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-de49b452-58ae-4c64-9157-3bb80ecd3af0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.152515 Jun 20 18:55:43.774750 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 509/1022] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:43 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:55:43.904958 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1a84fcc8-b959-492a-a003-edc1e2b9b0be tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "POST /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.744079 Jun 20 18:55:43.905882 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 514/1023] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jun 20 18:55:38 2022] POST /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments => generated 194 bytes in 5746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:55:44.462591 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-b6c83ca6-0042-4958-b0a5-4f3707242595 req-98b9abc9-1bb8-4193-a935-e18f4b002bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85165412-e44c-453d-aa22-d248bff1a459", "name": "network-vif-deleted", "tag": "12fa4b8e-1393-46da-afb1-ff594d0231e6"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:55:44.473564 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-b6c83ca6-0042-4958-b0a5-4f3707242595 req-98b9abc9-1bb8-4193-a935-e18f4b002bcb service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:44.474059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-b6c83ca6-0042-4958-b0a5-4f3707242595 req-98b9abc9-1bb8-4193-a935-e18f4b002bcb service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:44.506349 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-b6c83ca6-0042-4958-b0a5-4f3707242595 req-98b9abc9-1bb8-4193-a935-e18f4b002bcb service nova] Creating event network-vif-deleted:12fa4b8e-1393-46da-afb1-ff594d0231e6 for instance 85165412-e44c-453d-aa22-d248bff1a459 on hv-cinder-83697 Jun 20 18:55:44.511352 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-b6c83ca6-0042-4958-b0a5-4f3707242595 req-98b9abc9-1bb8-4193-a935-e18f4b002bcb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052771 Jun 20 18:55:44.511945 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 510/1024] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:55:44.623273 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f7e0f0a7-4ccb-470f-bdbc-951afdf10630 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:44.623964 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f7e0f0a7-4ccb-470f-bdbc-951afdf10630 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:44.631610 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f7e0f0a7-4ccb-470f-bdbc-951afdf10630 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:44.632050 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f7e0f0a7-4ccb-470f-bdbc-951afdf10630 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:44.632797 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f7e0f0a7-4ccb-470f-bdbc-951afdf10630 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:44.633223 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f7e0f0a7-4ccb-470f-bdbc-951afdf10630 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:44.697414 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-f7e0f0a7-4ccb-470f-bdbc-951afdf10630 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d3b9702e434e038466969abfae2338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb8f33898e2408eaaac28b7f1802314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:44.704910 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f7e0f0a7-4ccb-470f-bdbc-951afdf10630 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 200 len: 1218 microversion: 2.1 time: 0.086295 Jun 20 18:55:44.705462 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 515/1025] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:44 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:55:44.794245 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-af3b0053-d3e5-4e8d-ad5b-acf8c06a92fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:44.795000 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-af3b0053-d3e5-4e8d-ad5b-acf8c06a92fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:44.802102 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-af3b0053-d3e5-4e8d-ad5b-acf8c06a92fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:44.802556 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-af3b0053-d3e5-4e8d-ad5b-acf8c06a92fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:44.803359 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-af3b0053-d3e5-4e8d-ad5b-acf8c06a92fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:44.803797 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-af3b0053-d3e5-4e8d-ad5b-acf8c06a92fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:44.944926 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-af3b0053-d3e5-4e8d-ad5b-acf8c06a92fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:44.953166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-af3b0053-d3e5-4e8d-ad5b-acf8c06a92fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:44.954661 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-af3b0053-d3e5-4e8d-ad5b-acf8c06a92fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:44.955900 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-af3b0053-d3e5-4e8d-ad5b-acf8c06a92fe tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.165897 Jun 20 18:55:44.957073 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 511/1026] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:44 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:45.777869 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6b385bf7-2bf7-4092-acbb-2838c030b955 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:45.778495 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6b385bf7-2bf7-4092-acbb-2838c030b955 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] [instance: 85165412-e44c-453d-aa22-d248bff1a459] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:45.785142 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6b385bf7-2bf7-4092-acbb-2838c030b955 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:45.785580 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6b385bf7-2bf7-4092-acbb-2838c030b955 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:45.786330 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6b385bf7-2bf7-4092-acbb-2838c030b955 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:45.786760 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6b385bf7-2bf7-4092-acbb-2838c030b955 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:45.800125 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-6b385bf7-2bf7-4092-acbb-2838c030b955 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] HTTP exception thrown: Instance 85165412-e44c-453d-aa22-d248bff1a459 could not be found. Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6b385bf7-2bf7-4092-acbb-2838c030b955 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Request method failure captured: Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 HTTP/1.1 Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMDuS-YR4F1v6oaLzR-Wd_qGXmFNFqo5ncIXOIkS8_Mm74hDDy-r_FVCJTKaFwT1J27hMy6w3cb7t_qBmzRuw8mhElHOi8JfOzsUmDiEFOy-XlSoHzs3sdFKH4AcVzPnn0H1oodY2XQZiErl_730KSF3X-gK76sdhzg2QAhC8eXQ-Dc Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: afb8f33898e2408eaaac28b7f1802314 Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-TestShelveInstance-1084093013 Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:55:45.801739 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:55:45.803388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_afb8f33898e2408eaaac28b7f1802314", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/afb8f33898e2408eaaac28b7f1802314"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/afb8f33898e2408eaaac28b7f1802314"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/afb8f33898e2408eaaac28b7f1802314"}]}] Jun 20 18:55:45.803388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-TestShelveInstance-1084093013 Jun 20 18:55:45.803388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: afb8f33898e2408eaaac28b7f1802314 Jun 20 18:55:45.803388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-TestShelveInstance-1084093013 Jun 20 18:55:45.803388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-TestShelveInstance-1084093013-project Jun 20 18:55:45.803388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:55:45.803388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:55:45.803388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: a5d3b9702e434e038466969abfae2338 Jun 20 18:55:45.803388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-TestShelveInstance-1084093013-project Jun 20 18:55:45.803388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:55:45.803388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance 85165412-e44c-453d-aa22-d248bff1a459 could not be found. Jun 20 18:55:45.803388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '85165412-e44c-453d-aa22-d248bff1a459'} Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85165412-e44c-453d-aa22-d248bff1a459 could not be found. Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:55:45.804311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85165412-e44c-453d-aa22-d248bff1a459 could not be found. Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85165412-e44c-453d-aa22-d248bff1a459 could not be found. Jun 20 18:55:45.805806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:55:45.807205 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6b385bf7-2bf7-4092-acbb-2838c030b955 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Returning 404 to user: Instance 85165412-e44c-453d-aa22-d248bff1a459 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:55:45.807205 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6b385bf7-2bf7-4092-acbb-2838c030b955 tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459" status: 404 len: 111 microversion: 2.1 time: 0.029059 Jun 20 18:55:45.807205 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 516/1027] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:55:45 2022] GET /compute/v2.1/servers/85165412-e44c-453d-aa22-d248bff1a459 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 18:55:45.959440 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-66ade18a-063f-4468-909e-1acff40f442f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] Calling method '.version_select at 0x7f7e4907e700>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:45.977457 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-053b85c5-f3ad-4744-b17c-df069afa8605 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:45.979386 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-053b85c5-f3ad-4744-b17c-df069afa8605 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:45.981352 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-66ade18a-063f-4468-909e-1acff40f442f tempest-TestShelveInstance-1084093013 tempest-TestShelveInstance-1084093013-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-997547484" status: 202 len: 0 microversion: 2.1 time: 0.026418 Jun 20 18:55:45.982000 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 512/1028] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jun 20 18:55:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-997547484 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 18:55:45.990668 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-053b85c5-f3ad-4744-b17c-df069afa8605 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:45.991723 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-053b85c5-f3ad-4744-b17c-df069afa8605 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:45.992668 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-053b85c5-f3ad-4744-b17c-df069afa8605 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:45.993251 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-053b85c5-f3ad-4744-b17c-df069afa8605 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:46.146872 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-053b85c5-f3ad-4744-b17c-df069afa8605 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:46.154790 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-053b85c5-f3ad-4744-b17c-df069afa8605 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:46.156315 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-053b85c5-f3ad-4744-b17c-df069afa8605 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:46.157459 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-053b85c5-f3ad-4744-b17c-df069afa8605 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.186651 Jun 20 18:55:46.158011 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 517/1029] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:45 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:46.641951 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-d778e6fe-8893-43e6-becf-2d0670172f23 req-8ebdc090-741e-4f21-9823-d918af96a908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb97000-4705-4f02-bdd0-00047a203abf", "name": "network-vif-plugged", "status": "completed", "tag": "d20d672a-4e79-42b8-b764-55a554f24b8b"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:55:46.651175 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-d778e6fe-8893-43e6-becf-2d0670172f23 req-8ebdc090-741e-4f21-9823-d918af96a908 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:46.651841 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-d778e6fe-8893-43e6-becf-2d0670172f23 req-8ebdc090-741e-4f21-9823-d918af96a908 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:46.667778 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-d778e6fe-8893-43e6-becf-2d0670172f23 req-8ebdc090-741e-4f21-9823-d918af96a908 service nova] Creating event network-vif-plugged:d20d672a-4e79-42b8-b764-55a554f24b8b for instance dcb97000-4705-4f02-bdd0-00047a203abf on hv-cinder-83697 Jun 20 18:55:46.673376 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-d778e6fe-8893-43e6-becf-2d0670172f23 req-8ebdc090-741e-4f21-9823-d918af96a908 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035387 Jun 20 18:55:46.675941 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 513/1030] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:55:47.175801 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-aae18618-1d66-4c8e-9e88-88db9d2d05c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:47.177043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-aae18618-1d66-4c8e-9e88-88db9d2d05c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:47.183838 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-aae18618-1d66-4c8e-9e88-88db9d2d05c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:47.184276 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-aae18618-1d66-4c8e-9e88-88db9d2d05c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:47.185044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-aae18618-1d66-4c8e-9e88-88db9d2d05c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:47.185477 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-aae18618-1d66-4c8e-9e88-88db9d2d05c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:47.190013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:47.324093 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-aae18618-1d66-4c8e-9e88-88db9d2d05c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:47.332098 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-aae18618-1d66-4c8e-9e88-88db9d2d05c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:47.333584 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-aae18618-1d66-4c8e-9e88-88db9d2d05c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:47.334727 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-aae18618-1d66-4c8e-9e88-88db9d2d05c1 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.162991 Jun 20 18:55:47.335310 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 518/1031] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:47 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:48.354294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-33b20f40-7c52-42ea-82ca-1b8933a56bc7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:48.355262 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-33b20f40-7c52-42ea-82ca-1b8933a56bc7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:48.362343 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-33b20f40-7c52-42ea-82ca-1b8933a56bc7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:48.362819 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-33b20f40-7c52-42ea-82ca-1b8933a56bc7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:48.363623 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-33b20f40-7c52-42ea-82ca-1b8933a56bc7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:48.364055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-33b20f40-7c52-42ea-82ca-1b8933a56bc7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:48.599755 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-33b20f40-7c52-42ea-82ca-1b8933a56bc7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:48.607800 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-33b20f40-7c52-42ea-82ca-1b8933a56bc7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:48.609310 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-33b20f40-7c52-42ea-82ca-1b8933a56bc7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:48.610476 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-33b20f40-7c52-42ea-82ca-1b8933a56bc7 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.260535 Jun 20 18:55:48.611068 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 514/1032] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:48 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:49.629570 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-eec1b61d-8f27-400e-9963-7289caa45146 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:49.630170 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-eec1b61d-8f27-400e-9963-7289caa45146 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:49.638181 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-eec1b61d-8f27-400e-9963-7289caa45146 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:49.639052 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-eec1b61d-8f27-400e-9963-7289caa45146 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:49.640113 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-eec1b61d-8f27-400e-9963-7289caa45146 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:49.640546 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-eec1b61d-8f27-400e-9963-7289caa45146 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:49.862505 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-eec1b61d-8f27-400e-9963-7289caa45146 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:49.870887 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-eec1b61d-8f27-400e-9963-7289caa45146 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:49.872442 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-eec1b61d-8f27-400e-9963-7289caa45146 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:49.873810 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-eec1b61d-8f27-400e-9963-7289caa45146 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1731 microversion: 2.20 time: 0.248565 Jun 20 18:55:49.884284 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 519/1033] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:49 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:50.892096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d72ee975-c222-4db1-8245-3522b88ffa90 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:50.893595 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d72ee975-c222-4db1-8245-3522b88ffa90 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:50.900318 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d72ee975-c222-4db1-8245-3522b88ffa90 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:50.900903 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d72ee975-c222-4db1-8245-3522b88ffa90 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:50.902254 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d72ee975-c222-4db1-8245-3522b88ffa90 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:50.902695 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d72ee975-c222-4db1-8245-3522b88ffa90 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:51.055441 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d72ee975-c222-4db1-8245-3522b88ffa90 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:51.063903 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d72ee975-c222-4db1-8245-3522b88ffa90 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:51.065556 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-d72ee975-c222-4db1-8245-3522b88ffa90 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:55:51.067609 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d72ee975-c222-4db1-8245-3522b88ffa90 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1718 microversion: 2.20 time: 0.179574 Jun 20 18:55:51.068239 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 515/1034] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:55:50 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1718 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:55:51.485802 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ecbcf12b-b531-496f-9970-260429b28c2e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:51.487409 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ecbcf12b-b531-496f-9970-260429b28c2e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:51.494040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ecbcf12b-b531-496f-9970-260429b28c2e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:51.494495 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ecbcf12b-b531-496f-9970-260429b28c2e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:51.495351 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ecbcf12b-b531-496f-9970-260429b28c2e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:51.495959 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ecbcf12b-b531-496f-9970-260429b28c2e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:51.526213 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ecbcf12b-b531-496f-9970-260429b28c2e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044320 Jun 20 18:55:51.531645 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 520/1035] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:55:51 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:55:51.537642 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c3601f90-b66c-40d6-a09e-ffd5be6f16d5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:55:51.538393 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c3601f90-b66c-40d6-a09e-ffd5be6f16d5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:51.545229 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c3601f90-b66c-40d6-a09e-ffd5be6f16d5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:51.545744 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c3601f90-b66c-40d6-a09e-ffd5be6f16d5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:51.546600 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c3601f90-b66c-40d6-a09e-ffd5be6f16d5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:51.547144 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c3601f90-b66c-40d6-a09e-ffd5be6f16d5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:51.576659 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c3601f90-b66c-40d6-a09e-ffd5be6f16d5 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments/5b654646-6b79-49c0-bbc3-379410da2bf4" status: 200 len: 194 microversion: 2.1 time: 0.043615 Jun 20 18:55:51.577366 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 516/1036] 10.222.0.43 () {58 vars in 1412 bytes} [Mon Jun 20 18:55:51 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments/5b654646-6b79-49c0-bbc3-379410da2bf4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:55:52.958955 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3aaa3fae-879a-4f5b-a9d0-4339ce210510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f010450-f342-41e4-b0fd-544c3b7c60f4"}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:55:52.960070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-3aaa3fae-879a-4f5b-a9d0-4339ce210510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:55:52.967466 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3aaa3fae-879a-4f5b-a9d0-4339ce210510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:52.967949 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3aaa3fae-879a-4f5b-a9d0-4339ce210510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:52.968858 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3aaa3fae-879a-4f5b-a9d0-4339ce210510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:55:52.969411 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3aaa3fae-879a-4f5b-a9d0-4339ce210510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:55:53.232463 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-3aaa3fae-879a-4f5b-a9d0-4339ce210510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "POST /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277188 Jun 20 18:55:53.232994 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 521/1037] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jun 20 18:55:52 2022] POST /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:12.281737 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-626cca10-d122-4228-821c-a634d2ce17bd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:12.282663 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-626cca10-d122-4228-821c-a634d2ce17bd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:12.285314 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:12.285960 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=31 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:12.292493 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-626cca10-d122-4228-821c-a634d2ce17bd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:12.292939 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-626cca10-d122-4228-821c-a634d2ce17bd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:12.293707 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-626cca10-d122-4228-821c-a634d2ce17bd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:12.294145 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-626cca10-d122-4228-821c-a634d2ce17bd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:12.323515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-626cca10-d122-4228-821c-a634d2ce17bd tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045688 Jun 20 18:56:12.324067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 517/1038] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:56:12 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:12.466358 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=23 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:12.467158 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:12.471584 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8d73593e-58aa-474b-badf-4f3d947bdf60 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:12.472153 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8d73593e-58aa-474b-badf-4f3d947bdf60 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:12.479879 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8d73593e-58aa-474b-badf-4f3d947bdf60 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:12.480325 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8d73593e-58aa-474b-badf-4f3d947bdf60 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:12.481069 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8d73593e-58aa-474b-badf-4f3d947bdf60 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:12.481496 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8d73593e-58aa-474b-badf-4f3d947bdf60 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:12.511475 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8d73593e-58aa-474b-badf-4f3d947bdf60 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments/5b654646-6b79-49c0-bbc3-379410da2bf4" status: 200 len: 194 microversion: 2.1 time: 0.046893 Jun 20 18:56:12.512047 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 522/1039] 10.222.0.43 () {58 vars in 1412 bytes} [Mon Jun 20 18:56:12 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments/5b654646-6b79-49c0-bbc3-379410da2bf4 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:12.521735 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5cde2f80-23fc-4e12-872f-3884f14fb6d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:12.522227 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5cde2f80-23fc-4e12-872f-3884f14fb6d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:12.528234 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5cde2f80-23fc-4e12-872f-3884f14fb6d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:12.528686 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5cde2f80-23fc-4e12-872f-3884f14fb6d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:12.529454 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5cde2f80-23fc-4e12-872f-3884f14fb6d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:12.529891 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5cde2f80-23fc-4e12-872f-3884f14fb6d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:12.809590 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-5cde2f80-23fc-4e12-872f-3884f14fb6d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lazy-loading 'services' on Instance uuid 9599ed34-1484-4080-9eb5-478b932f55a0 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:56:12.883325 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5cde2f80-23fc-4e12-872f-3884f14fb6d7 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments/5b654646-6b79-49c0-bbc3-379410da2bf4" status: 202 len: 0 microversion: 2.1 time: 0.365448 Jun 20 18:56:12.883934 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 518/1040] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jun 20 18:56:12 2022] DELETE /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments/5b654646-6b79-49c0-bbc3-379410da2bf4 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:56:15.044707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d65973a8-81a5-4d99-9f9e-290e47f5ff80 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:15.045233 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d65973a8-81a5-4d99-9f9e-290e47f5ff80 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:15.051515 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d65973a8-81a5-4d99-9f9e-290e47f5ff80 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:15.051959 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d65973a8-81a5-4d99-9f9e-290e47f5ff80 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:15.052734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d65973a8-81a5-4d99-9f9e-290e47f5ff80 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:15.053159 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d65973a8-81a5-4d99-9f9e-290e47f5ff80 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:15.082543 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d65973a8-81a5-4d99-9f9e-290e47f5ff80 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments/6f010450-f342-41e4-b0fd-544c3b7c60f4" status: 200 len: 194 microversion: 2.1 time: 0.041764 Jun 20 18:56:15.083137 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 523/1041] 10.222.0.43 () {58 vars in 1412 bytes} [Mon Jun 20 18:56:15 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments/6f010450-f342-41e4-b0fd-544c3b7c60f4 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:15.093770 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-895cdf59-0d6a-40da-b3e6-1d8f145f8424 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:15.094341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-895cdf59-0d6a-40da-b3e6-1d8f145f8424 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:15.100515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-895cdf59-0d6a-40da-b3e6-1d8f145f8424 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:15.100957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-895cdf59-0d6a-40da-b3e6-1d8f145f8424 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:15.101707 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-895cdf59-0d6a-40da-b3e6-1d8f145f8424 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:15.102130 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-895cdf59-0d6a-40da-b3e6-1d8f145f8424 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:15.179195 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-895cdf59-0d6a-40da-b3e6-1d8f145f8424 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lazy-loading 'services' on Instance uuid 9599ed34-1484-4080-9eb5-478b932f55a0 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:56:15.247265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-895cdf59-0d6a-40da-b3e6-1d8f145f8424 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments/6f010450-f342-41e4-b0fd-544c3b7c60f4" status: 202 len: 0 microversion: 2.1 time: 0.157976 Jun 20 18:56:15.247780 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 519/1042] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jun 20 18:56:15 2022] DELETE /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments/6f010450-f342-41e4-b0fd-544c3b7c60f4 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:56:16.403296 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0b50dd1b-c7d1-4dff-9499-a0da626b4bbc tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:16.404218 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0b50dd1b-c7d1-4dff-9499-a0da626b4bbc tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:16.411189 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0b50dd1b-c7d1-4dff-9499-a0da626b4bbc tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:16.411637 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0b50dd1b-c7d1-4dff-9499-a0da626b4bbc tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:16.412403 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0b50dd1b-c7d1-4dff-9499-a0da626b4bbc tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:16.412822 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-0b50dd1b-c7d1-4dff-9499-a0da626b4bbc tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:16.440758 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0b50dd1b-c7d1-4dff-9499-a0da626b4bbc tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041390 Jun 20 18:56:16.441300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 524/1043] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:56:16 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 18:56:16.546333 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5987b2f7-fbea-48ea-8453-c82ae7d7a359 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:16.547506 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5987b2f7-fbea-48ea-8453-c82ae7d7a359 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:16.553761 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5987b2f7-fbea-48ea-8453-c82ae7d7a359 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:16.554206 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5987b2f7-fbea-48ea-8453-c82ae7d7a359 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:16.554993 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5987b2f7-fbea-48ea-8453-c82ae7d7a359 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:16.555427 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5987b2f7-fbea-48ea-8453-c82ae7d7a359 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:16.584979 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5987b2f7-fbea-48ea-8453-c82ae7d7a359 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043267 Jun 20 18:56:16.585452 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 520/1044] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:56:16 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 18:56:16.646292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-582d0d6d-c8a2-48e9-90e7-3b0e11db11fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:16.646778 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-582d0d6d-c8a2-48e9-90e7-3b0e11db11fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:16.652694 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-582d0d6d-c8a2-48e9-90e7-3b0e11db11fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:16.653134 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-582d0d6d-c8a2-48e9-90e7-3b0e11db11fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:16.653883 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-582d0d6d-c8a2-48e9-90e7-3b0e11db11fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:16.654309 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-582d0d6d-c8a2-48e9-90e7-3b0e11db11fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:16.677951 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-582d0d6d-c8a2-48e9-90e7-3b0e11db11fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Going to try to terminate instance {{(pid=124189) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:56:16.754398 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-582d0d6d-c8a2-48e9-90e7-3b0e11db11fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 204 len: 0 microversion: 2.1 time: 0.112056 Jun 20 18:56:16.755128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 525/1045] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:56:16 2022] DELETE /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:56:16.763990 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a1aa253c-48a7-46fa-9db2-4af72ecbf510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:16.764598 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a1aa253c-48a7-46fa-9db2-4af72ecbf510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:16.771210 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a1aa253c-48a7-46fa-9db2-4af72ecbf510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:16.771657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a1aa253c-48a7-46fa-9db2-4af72ecbf510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:16.772411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a1aa253c-48a7-46fa-9db2-4af72ecbf510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:16.772862 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a1aa253c-48a7-46fa-9db2-4af72ecbf510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:16.901695 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a1aa253c-48a7-46fa-9db2-4af72ecbf510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:16.909103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a1aa253c-48a7-46fa-9db2-4af72ecbf510 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1674 microversion: 2.1 time: 0.149036 Jun 20 18:56:16.909710 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 521/1046] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:56:16 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:56:17.927893 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-413fb80e-a63e-40b9-b6d2-e6a3110ccb97 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:17.928511 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-413fb80e-a63e-40b9-b6d2-e6a3110ccb97 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:17.934907 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-413fb80e-a63e-40b9-b6d2-e6a3110ccb97 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:17.935378 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-413fb80e-a63e-40b9-b6d2-e6a3110ccb97 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:17.936128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-413fb80e-a63e-40b9-b6d2-e6a3110ccb97 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:17.936558 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-413fb80e-a63e-40b9-b6d2-e6a3110ccb97 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:18.160408 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-413fb80e-a63e-40b9-b6d2-e6a3110ccb97 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:18.168142 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-413fb80e-a63e-40b9-b6d2-e6a3110ccb97 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1674 microversion: 2.1 time: 0.245176 Jun 20 18:56:18.168692 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 526/1047] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:56:17 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1674 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:56:19.185558 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-91a616d1-29f3-47f2-9a23-916641e5da76 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:19.186185 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-91a616d1-29f3-47f2-9a23-916641e5da76 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:19.192812 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91a616d1-29f3-47f2-9a23-916641e5da76 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:19.193253 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91a616d1-29f3-47f2-9a23-916641e5da76 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:19.194001 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91a616d1-29f3-47f2-9a23-916641e5da76 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:19.194428 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-91a616d1-29f3-47f2-9a23-916641e5da76 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:19.321111 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-91a616d1-29f3-47f2-9a23-916641e5da76 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:19.328577 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-91a616d1-29f3-47f2-9a23-916641e5da76 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1674 microversion: 2.1 time: 0.146874 Jun 20 18:56:19.329130 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 522/1048] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:56:19 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:56:19.785166 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-8ac0fbec-a6c0-474f-9a7f-315aa6ec196c req-efb8719c-a1cd-4464-b81d-dd5e795e0dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9599ed34-1484-4080-9eb5-478b932f55a0", "name": "network-vif-deleted", "tag": "0e831b7c-cf98-4e3a-9684-438217582746"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:56:19.794172 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-8ac0fbec-a6c0-474f-9a7f-315aa6ec196c req-efb8719c-a1cd-4464-b81d-dd5e795e0dc4 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:19.794705 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-8ac0fbec-a6c0-474f-9a7f-315aa6ec196c req-efb8719c-a1cd-4464-b81d-dd5e795e0dc4 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:19.806565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-8ac0fbec-a6c0-474f-9a7f-315aa6ec196c req-efb8719c-a1cd-4464-b81d-dd5e795e0dc4 service nova] Creating event network-vif-deleted:0e831b7c-cf98-4e3a-9684-438217582746 for instance 9599ed34-1484-4080-9eb5-478b932f55a0 on hv-cinder-83697 Jun 20 18:56:19.811599 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-8ac0fbec-a6c0-474f-9a7f-315aa6ec196c req-efb8719c-a1cd-4464-b81d-dd5e795e0dc4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030757 Jun 20 18:56:19.812261 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 527/1049] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:20.345741 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-71e08d6c-1396-4c9b-a1dd-119214902d08 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:20.347678 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-71e08d6c-1396-4c9b-a1dd-119214902d08 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:20.355994 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-71e08d6c-1396-4c9b-a1dd-119214902d08 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:20.356450 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-71e08d6c-1396-4c9b-a1dd-119214902d08 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:20.357426 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-71e08d6c-1396-4c9b-a1dd-119214902d08 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:20.357876 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-71e08d6c-1396-4c9b-a1dd-119214902d08 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:20.392012 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-71e08d6c-1396-4c9b-a1dd-119214902d08 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:20.392465 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-71e08d6c-1396-4c9b-a1dd-119214902d08 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:20.393171 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-71e08d6c-1396-4c9b-a1dd-119214902d08 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lazy-loading 'fault' on Instance uuid 9599ed34-1484-4080-9eb5-478b932f55a0 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:56:20.438450 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-71e08d6c-1396-4c9b-a1dd-119214902d08 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016cfd43630b42f38efcd37ea9a66a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e724578c7aab45bb8ae2317c33e3be33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:20.447779 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-71e08d6c-1396-4c9b-a1dd-119214902d08 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 200 len: 1328 microversion: 2.1 time: 0.105805 Jun 20 18:56:20.448367 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 523/1050] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:56:20 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:56:21.465786 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4914baba-afce-4fbc-9018-e7e3e1fe3499 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:21.466481 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-4914baba-afce-4fbc-9018-e7e3e1fe3499 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:21.473867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4914baba-afce-4fbc-9018-e7e3e1fe3499 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:21.474314 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4914baba-afce-4fbc-9018-e7e3e1fe3499 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:21.475135 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4914baba-afce-4fbc-9018-e7e3e1fe3499 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:21.475568 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4914baba-afce-4fbc-9018-e7e3e1fe3499 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:21.488354 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-4914baba-afce-4fbc-9018-e7e3e1fe3499 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] HTTP exception thrown: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4914baba-afce-4fbc-9018-e7e3e1fe3499 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Request method failure captured: Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 HTTP/1.1 Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMByfBN7Azj5ezBS-4LHeZitSTwRsW6M-U9cDLTjOzRO_mZ-F6TlZluQNdBIbLndGNDG7AR8HXGA_w-uK_xFYQmlhUuWqJ4ow5s3D12SO198AC9obL7HI19lFh67b-OaPUMFtrMo4Pb-kYSd8VK-1yo-jQlpsxxpYCOStIKU6_AMBEQ Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: e724578c7aab45bb8ae2317c33e3be33 Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:56:21.489973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:56:21.491606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e724578c7aab45bb8ae2317c33e3be33", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e724578c7aab45bb8ae2317c33e3be33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e724578c7aab45bb8ae2317c33e3be33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e724578c7aab45bb8ae2317c33e3be33"}]}] Jun 20 18:56:21.491606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:21.491606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: e724578c7aab45bb8ae2317c33e3be33 Jun 20 18:56:21.491606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:21.491606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-AttachVolumeTestJSON-457969774-project Jun 20 18:56:21.491606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:56:21.491606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:56:21.491606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 016cfd43630b42f38efcd37ea9a66a10 Jun 20 18:56:21.491606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-AttachVolumeTestJSON-457969774-project Jun 20 18:56:21.491606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:56:21.491606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:21.491606 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '9599ed34-1484-4080-9eb5-478b932f55a0'} Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:21.492540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:21.494082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:21.495432 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4914baba-afce-4fbc-9018-e7e3e1fe3499 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Returning 404 to user: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:21.495432 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4914baba-afce-4fbc-9018-e7e3e1fe3499 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 404 len: 111 microversion: 2.1 time: 0.029820 Jun 20 18:56:21.495432 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 528/1051] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:56:21 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:56:21.500039 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4b9179ba-c5c8-48bf-9022-90e8f713b192 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '.version_select at 0x7f7e4907e820>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:21.516186 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4b9179ba-c5c8-48bf-9022-90e8f713b192 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185164739" status: 202 len: 0 microversion: 2.1 time: 0.019979 Jun 20 18:56:21.520218 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 524/1052] 10.222.0.43 () {58 vars in 1220 bytes} [Mon Jun 20 18:56:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185164739 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:56:24.364895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7507fe35-6cd3-42aa-974c-03bb7349e891 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:24.365368 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-7507fe35-6cd3-42aa-974c-03bb7349e891 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:24.371911 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7507fe35-6cd3-42aa-974c-03bb7349e891 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:24.372351 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7507fe35-6cd3-42aa-974c-03bb7349e891 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:24.373091 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7507fe35-6cd3-42aa-974c-03bb7349e891 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:24.373516 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-7507fe35-6cd3-42aa-974c-03bb7349e891 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:24.386596 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-7507fe35-6cd3-42aa-974c-03bb7349e891 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] HTTP exception thrown: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7507fe35-6cd3-42aa-974c-03bb7349e891 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Request method failure captured: Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: DELETE /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 HTTP/1.1 Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMByfBN7Azj5ezBS-4LHeZitSTwRsW6M-U9cDLTjOzRO_mZ-F6TlZluQNdBIbLndGNDG7AR8HXGA_w-uK_xFYQmlhUuWqJ4ow5s3D12SO198AC9obL7HI19lFh67b-OaPUMFtrMo4Pb-kYSd8VK-1yo-jQlpsxxpYCOStIKU6_AMBEQ Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: e724578c7aab45bb8ae2317c33e3be33 Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:56:24.388157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:56:24.389701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e724578c7aab45bb8ae2317c33e3be33", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e724578c7aab45bb8ae2317c33e3be33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e724578c7aab45bb8ae2317c33e3be33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e724578c7aab45bb8ae2317c33e3be33"}]}] Jun 20 18:56:24.389701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:24.389701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: e724578c7aab45bb8ae2317c33e3be33 Jun 20 18:56:24.389701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:24.389701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-AttachVolumeTestJSON-457969774-project Jun 20 18:56:24.389701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:56:24.389701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:56:24.389701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 016cfd43630b42f38efcd37ea9a66a10 Jun 20 18:56:24.389701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-AttachVolumeTestJSON-457969774-project Jun 20 18:56:24.389701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:56:24.389701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:24.389701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '9599ed34-1484-4080-9eb5-478b932f55a0'} Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:24.390535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:24.392041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:24.393932 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7507fe35-6cd3-42aa-974c-03bb7349e891 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Returning 404 to user: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:24.393932 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7507fe35-6cd3-42aa-974c-03bb7349e891 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 404 len: 111 microversion: 2.1 time: 0.028394 Jun 20 18:56:24.393932 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 529/1053] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:56:24 2022] DELETE /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:56:24.398938 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-61c23474-e9ee-45ac-89b7-1f2c4762e2fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:24.399556 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-61c23474-e9ee-45ac-89b7-1f2c4762e2fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 9599ed34-1484-4080-9eb5-478b932f55a0] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:24.405539 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-61c23474-e9ee-45ac-89b7-1f2c4762e2fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:24.405988 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-61c23474-e9ee-45ac-89b7-1f2c4762e2fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:24.406743 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-61c23474-e9ee-45ac-89b7-1f2c4762e2fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:24.407207 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-61c23474-e9ee-45ac-89b7-1f2c4762e2fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:24.421439 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-61c23474-e9ee-45ac-89b7-1f2c4762e2fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] HTTP exception thrown: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-61c23474-e9ee-45ac-89b7-1f2c4762e2fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Request method failure captured: Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 HTTP/1.1 Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMByfBN7Azj5ezBS-4LHeZitSTwRsW6M-U9cDLTjOzRO_mZ-F6TlZluQNdBIbLndGNDG7AR8HXGA_w-uK_xFYQmlhUuWqJ4ow5s3D12SO198AC9obL7HI19lFh67b-OaPUMFtrMo4Pb-kYSd8VK-1yo-jQlpsxxpYCOStIKU6_AMBEQ Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: e724578c7aab45bb8ae2317c33e3be33 Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:56:24.423104 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:56:24.424655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e724578c7aab45bb8ae2317c33e3be33", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e724578c7aab45bb8ae2317c33e3be33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e724578c7aab45bb8ae2317c33e3be33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e724578c7aab45bb8ae2317c33e3be33"}]}] Jun 20 18:56:24.424655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:24.424655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: e724578c7aab45bb8ae2317c33e3be33 Jun 20 18:56:24.424655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:24.424655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-AttachVolumeTestJSON-457969774-project Jun 20 18:56:24.424655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:56:24.424655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:56:24.424655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 016cfd43630b42f38efcd37ea9a66a10 Jun 20 18:56:24.424655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-AttachVolumeTestJSON-457969774-project Jun 20 18:56:24.424655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:56:24.424655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:24.424655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': '9599ed34-1484-4080-9eb5-478b932f55a0'} Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:24.425575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. Jun 20 18:56:24.427119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:24.428417 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-61c23474-e9ee-45ac-89b7-1f2c4762e2fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Returning 404 to user: Instance 9599ed34-1484-4080-9eb5-478b932f55a0 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:24.428417 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-61c23474-e9ee-45ac-89b7-1f2c4762e2fb tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0" status: 404 len: 111 microversion: 2.1 time: 0.030074 Jun 20 18:56:24.428417 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 525/1054] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:56:24 2022] GET /compute/v2.1/servers/9599ed34-1484-4080-9eb5-478b932f55a0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:56:25.554247 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4800f1b3-b805-43a3-b4e3-86ab5b9542d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:25.554727 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-4800f1b3-b805-43a3-b4e3-86ab5b9542d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:25.561103 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4800f1b3-b805-43a3-b4e3-86ab5b9542d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:25.561538 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4800f1b3-b805-43a3-b4e3-86ab5b9542d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:25.562284 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4800f1b3-b805-43a3-b4e3-86ab5b9542d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:25.562707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4800f1b3-b805-43a3-b4e3-86ab5b9542d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:25.576185 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-4800f1b3-b805-43a3-b4e3-86ab5b9542d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] HTTP exception thrown: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4800f1b3-b805-43a3-b4e3-86ab5b9542d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Request method failure captured: Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: DELETE /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 HTTP/1.1 Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMByfBN7Azj5ezBS-4LHeZitSTwRsW6M-U9cDLTjOzRO_mZ-F6TlZluQNdBIbLndGNDG7AR8HXGA_w-uK_xFYQmlhUuWqJ4ow5s3D12SO198AC9obL7HI19lFh67b-OaPUMFtrMo4Pb-kYSd8VK-1yo-jQlpsxxpYCOStIKU6_AMBEQ Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: e724578c7aab45bb8ae2317c33e3be33 Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:56:25.577699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:56:25.579300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e724578c7aab45bb8ae2317c33e3be33", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e724578c7aab45bb8ae2317c33e3be33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e724578c7aab45bb8ae2317c33e3be33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e724578c7aab45bb8ae2317c33e3be33"}]}] Jun 20 18:56:25.579300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:25.579300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: e724578c7aab45bb8ae2317c33e3be33 Jun 20 18:56:25.579300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:25.579300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-AttachVolumeTestJSON-457969774-project Jun 20 18:56:25.579300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:56:25.579300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:56:25.579300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 016cfd43630b42f38efcd37ea9a66a10 Jun 20 18:56:25.579300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-AttachVolumeTestJSON-457969774-project Jun 20 18:56:25.579300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:56:25.579300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:56:25.579300 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '2614c08f-0c19-4066-8c87-551d4ac2f725'} Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:25.580176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:56:25.582292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:25.583822 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4800f1b3-b805-43a3-b4e3-86ab5b9542d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Returning 404 to user: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:25.583822 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4800f1b3-b805-43a3-b4e3-86ab5b9542d8 tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 404 len: 111 microversion: 2.1 time: 0.028645 Jun 20 18:56:25.583822 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 530/1055] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:56:25 2022] DELETE /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:56:25.588985 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-df724bde-f920-4847-8c4a-3514578be66e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:25.589593 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-df724bde-f920-4847-8c4a-3514578be66e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] [instance: 2614c08f-0c19-4066-8c87-551d4ac2f725] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:25.596030 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-df724bde-f920-4847-8c4a-3514578be66e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:25.596503 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-df724bde-f920-4847-8c4a-3514578be66e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:25.597259 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-df724bde-f920-4847-8c4a-3514578be66e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:25.597692 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-df724bde-f920-4847-8c4a-3514578be66e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:25.610827 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-df724bde-f920-4847-8c4a-3514578be66e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] HTTP exception thrown: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-df724bde-f920-4847-8c4a-3514578be66e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Request method failure captured: Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 HTTP/1.1 Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMByfBN7Azj5ezBS-4LHeZitSTwRsW6M-U9cDLTjOzRO_mZ-F6TlZluQNdBIbLndGNDG7AR8HXGA_w-uK_xFYQmlhUuWqJ4ow5s3D12SO198AC9obL7HI19lFh67b-OaPUMFtrMo4Pb-kYSd8VK-1yo-jQlpsxxpYCOStIKU6_AMBEQ Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: e724578c7aab45bb8ae2317c33e3be33 Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:56:25.612398 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:56:25.613936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e724578c7aab45bb8ae2317c33e3be33", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e724578c7aab45bb8ae2317c33e3be33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e724578c7aab45bb8ae2317c33e3be33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e724578c7aab45bb8ae2317c33e3be33"}]}] Jun 20 18:56:25.613936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:25.613936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: e724578c7aab45bb8ae2317c33e3be33 Jun 20 18:56:25.613936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-AttachVolumeTestJSON-457969774 Jun 20 18:56:25.613936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-AttachVolumeTestJSON-457969774-project Jun 20 18:56:25.613936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:56:25.613936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:56:25.613936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 016cfd43630b42f38efcd37ea9a66a10 Jun 20 18:56:25.613936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-AttachVolumeTestJSON-457969774-project Jun 20 18:56:25.613936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:56:25.613936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:56:25.613936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': '2614c08f-0c19-4066-8c87-551d4ac2f725'} Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:25.614840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. Jun 20 18:56:25.616319 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:25.617613 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-df724bde-f920-4847-8c4a-3514578be66e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] Returning 404 to user: Instance 2614c08f-0c19-4066-8c87-551d4ac2f725 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:25.617613 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-df724bde-f920-4847-8c4a-3514578be66e tempest-AttachVolumeTestJSON-457969774 tempest-AttachVolumeTestJSON-457969774-project] 10.222.0.43 "GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725" status: 404 len: 111 microversion: 2.1 time: 0.029785 Jun 20 18:56:25.617613 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 526/1056] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:56:25 2022] GET /compute/v2.1/servers/2614c08f-0c19-4066-8c87-551d4ac2f725 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:56:29.846156 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-2960adb0-8fa3-4cca-8038-13853658f87a tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] Action: 'create', calling method: .version_select at 0x7f7e452d5ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-805995379", "metadata": {"Type": "work"}}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:56:30.125053 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-2960adb0-8fa3-4cca-8038-13853658f87a tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.395891 Jun 20 18:56:30.125678 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 531/1057] 10.222.0.43 () {60 vars in 1155 bytes} [Mon Jun 20 18:56:29 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 397 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 18:56:30.136892 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f6da0f00-d707-43b6-9ffb-4b2a363b0cf9 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] Calling method '.version_select at 0x7f7e4905e430>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:30.185587 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f6da0f00-d707-43b6-9ffb-4b2a363b0cf9 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/083dadbd-fe1e-4391-a1f1-9cd8c4874917" status: 200 len: 352 microversion: 2.1 time: 0.052458 Jun 20 18:56:30.186158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 527/1058] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:56:30 2022] GET /compute/v2.1/os-volumes/083dadbd-fe1e-4391-a1f1-9cd8c4874917 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:31.200323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9e26211e-4cb4-4ba6-8fbd-7addbb0b1cd1 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] Calling method '.version_select at 0x7f7e44921b80>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:31.246358 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9e26211e-4cb4-4ba6-8fbd-7addbb0b1cd1 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/083dadbd-fe1e-4391-a1f1-9cd8c4874917" status: 200 len: 353 microversion: 2.1 time: 0.050357 Jun 20 18:56:31.246961 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 532/1059] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:56:31 2022] GET /compute/v2.1/os-volumes/083dadbd-fe1e-4391-a1f1-9cd8c4874917 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:31.258524 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-343e19c2-9aa9-49d8-822a-8951827a03e7 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] Calling method '.version_select at 0x7f7e449dd040>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:31.303797 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-343e19c2-9aa9-49d8-822a-8951827a03e7 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/083dadbd-fe1e-4391-a1f1-9cd8c4874917" status: 200 len: 353 microversion: 2.1 time: 0.049797 Jun 20 18:56:31.304353 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 528/1060] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:56:31 2022] GET /compute/v2.1/os-volumes/083dadbd-fe1e-4391-a1f1-9cd8c4874917 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:31.315395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-41f15a43-a517-4e8d-841b-4b03d186cda1 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] Calling method '.version_select at 0x7f7e448f6040>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:31.375013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-41f15a43-a517-4e8d-841b-4b03d186cda1 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/083dadbd-fe1e-4391-a1f1-9cd8c4874917" status: 202 len: 0 microversion: 2.1 time: 0.063110 Jun 20 18:56:31.375603 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 533/1061] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jun 20 18:56:31 2022] DELETE /compute/v2.1/os-volumes/083dadbd-fe1e-4391-a1f1-9cd8c4874917 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:56:31.383783 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-544351e2-c587-4c79-bc15-3e11e3b23dd5 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] Calling method '.version_select at 0x7f7e49141160>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:31.432575 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-544351e2-c587-4c79-bc15-3e11e3b23dd5 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/083dadbd-fe1e-4391-a1f1-9cd8c4874917" status: 200 len: 352 microversion: 2.1 time: 0.052531 Jun 20 18:56:31.433136 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 529/1062] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:56:31 2022] GET /compute/v2.1/os-volumes/083dadbd-fe1e-4391-a1f1-9cd8c4874917 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:32.448655 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8ca8afac-5d0e-4bd8-89c0-3f22443ec100 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] Calling method '.version_select at 0x7f7e44a405e0>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:32.476576 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-8ca8afac-5d0e-4bd8-89c0-3f22443ec100 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] HTTP exception thrown: Volume 083dadbd-fe1e-4391-a1f1-9cd8c4874917 could not be found. Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8ca8afac-5d0e-4bd8-89c0-3f22443ec100 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] Request method failure captured: Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/os-volumes/083dadbd-fe1e-4391-a1f1-9cd8c4874917 HTTP/1.1 Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMLdU07CicsN85E-6Xq3_STsaRaQDcPaEcMzFu35FGzU3fpvGruPn20pSGSOHHgmjwujIHgj4NchshAMr_QU3811Qw2vc2e1lkST8qZAx2hsyVT13DUrAtVa5MHCuW2pj5WBLD2rUp8zGQiRzEeFLyI2RMpzUZE3GFJPoPKmT4DxBn8 Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 1e45d76a173848f7a3e5cc48d10ab88a Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-VolumesGetTestJSON-82521366 Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:56:32.478871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:56:32.480446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1e45d76a173848f7a3e5cc48d10ab88a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1e45d76a173848f7a3e5cc48d10ab88a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1e45d76a173848f7a3e5cc48d10ab88a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1e45d76a173848f7a3e5cc48d10ab88a"}]}] Jun 20 18:56:32.480446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-VolumesGetTestJSON-82521366 Jun 20 18:56:32.480446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 1e45d76a173848f7a3e5cc48d10ab88a Jun 20 18:56:32.480446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-VolumesGetTestJSON-82521366 Jun 20 18:56:32.480446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-VolumesGetTestJSON-82521366-project Jun 20 18:56:32.480446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:56:32.480446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:56:32.480446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 54986a6a3c1b42759785f01e97c123c1 Jun 20 18:56:32.480446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-VolumesGetTestJSON-82521366-project Jun 20 18:56:32.480446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: Jun 20 18:56:32.480446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Volume 083dadbd-fe1e-4391-a1f1-9cd8c4874917 could not be found. Jun 20 18:56:32.480446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '083dadbd-fe1e-4391-a1f1-9cd8c4874917'} Jun 20 18:56:32.480446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 083dadbd-fe1e-4391-a1f1-9cd8c4874917 could not be found. (HTTP 404) (Request-ID: req-7744c94f-9cc3-4142-a5de-1a23733eb2cc) Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:32.481450 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 18:56:32.482868 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 083dadbd-fe1e-4391-a1f1-9cd8c4874917 could not be found. Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 18:56:32.484362 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:56:32.485737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 083dadbd-fe1e-4391-a1f1-9cd8c4874917 could not be found. Jun 20 18:56:32.485737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:32.485737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:32.485737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:32.485737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:32.485737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:32.485737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:32.485737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:56:32.485737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:56:32.485737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 083dadbd-fe1e-4391-a1f1-9cd8c4874917 could not be found. Jun 20 18:56:32.485737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:32.485737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8ca8afac-5d0e-4bd8-89c0-3f22443ec100 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] Returning 404 to user: Volume 083dadbd-fe1e-4391-a1f1-9cd8c4874917 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:32.485737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8ca8afac-5d0e-4bd8-89c0-3f22443ec100 tempest-VolumesGetTestJSON-82521366 tempest-VolumesGetTestJSON-82521366-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/083dadbd-fe1e-4391-a1f1-9cd8c4874917" status: 404 len: 109 microversion: 2.1 time: 0.038534 Jun 20 18:56:32.485737 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 534/1063] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:56:32 2022] GET /compute/v2.1/os-volumes/083dadbd-fe1e-4391-a1f1-9cd8c4874917 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:56:35.128401 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-90387653-d562-4095-8f0a-aa875d700024 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] Calling method '.version_select at 0x7f7e491f8940>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:35.172879 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-90387653-d562-4095-8f0a-aa875d700024 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/4c4aadd4-d749-49bc-aaad-18a19eab0e19" status: 200 len: 351 microversion: 2.1 time: 0.049309 Jun 20 18:56:35.173505 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 530/1064] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:56:35 2022] GET /compute/v2.1/os-volumes/4c4aadd4-d749-49bc-aaad-18a19eab0e19 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:36.475835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:36.476590 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:36.480306 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4a67df72-8a0d-41eb-82ce-f66133e0fc82 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] Calling method '.version_select at 0x7f7e449c8940>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:36.525758 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4a67df72-8a0d-41eb-82ce-f66133e0fc82 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f68abb40-6924-4e13-9df2-f6f70914223f" status: 200 len: 351 microversion: 2.1 time: 0.051836 Jun 20 18:56:36.526323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 535/1065] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:56:36 2022] GET /compute/v2.1/os-volumes/f68abb40-6924-4e13-9df2-f6f70914223f => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:37.831441 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:37.832261 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:37.836581 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7f597645-c3c8-4cfa-bd66-361c4dea2967 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] Calling method '.version_select at 0x7f7e4905e670>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:37.882494 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7f597645-c3c8-4cfa-bd66-361c4dea2967 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c2c7269b-e476-486a-9a23-79f1a9b63167" status: 200 len: 350 microversion: 2.1 time: 0.052315 Jun 20 18:56:37.883084 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 531/1066] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:56:37 2022] GET /compute/v2.1/os-volumes/c2c7269b-e476-486a-9a23-79f1a9b63167 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:37.895215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-dd69d74c-68c2-4a60-877f-1cf84e7050a6 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] Calling method '.version_select at 0x7f7e448f6dc0>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:37.973894 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-dd69d74c-68c2-4a60-877f-1cf84e7050a6 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083390 Jun 20 18:56:37.974455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 536/1067] 10.222.0.43 () {58 vars in 1133 bytes} [Mon Jun 20 18:56:37 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:56:37.986174 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-710510e9-8d3e-427f-a0b3-3f33bb81c7f1 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] Calling method '.version_select at 0x7f7e449b9d30>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:38.065189 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-710510e9-8d3e-427f-a0b3-3f33bb81c7f1 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082632 Jun 20 18:56:38.065754 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 532/1068] 10.222.0.43 () {58 vars in 1148 bytes} [Mon Jun 20 18:56:37 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:38.077242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-eda8c95b-a7a0-4ba2-9629-f0aa11873cbd tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] Calling method '.version_select at 0x7f7e4531c8b0>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:38.156502 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-eda8c95b-a7a0-4ba2-9629-f0aa11873cbd tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083005 Jun 20 18:56:38.157551 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 537/1069] 10.222.0.43 () {58 vars in 1133 bytes} [Mon Jun 20 18:56:38 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:56:38.169215 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1379f5e6-e62a-4197-a083-857a2d4e6ca1 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] Calling method '.version_select at 0x7f7e449b9280>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:38.247595 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1379f5e6-e62a-4197-a083-857a2d4e6ca1 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082349 Jun 20 18:56:38.248158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 533/1070] 10.222.0.43 () {58 vars in 1166 bytes} [Mon Jun 20 18:56:38 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:38.261811 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-7ffb874e-110a-428e-b360-12cd0e818db9 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] Calling method '.version_select at 0x7f7e4475eb80>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:38.340404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-7ffb874e-110a-428e-b360-12cd0e818db9 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082244 Jun 20 18:56:38.340975 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 538/1071] 10.222.0.43 () {58 vars in 1169 bytes} [Mon Jun 20 18:56:38 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:38.352687 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-243619c3-1b84-420c-a958-f775e281a64a tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] Calling method '.version_select at 0x7f7e491f8430>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:38.432722 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-243619c3-1b84-420c-a958-f775e281a64a tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083698 Jun 20 18:56:38.433286 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 534/1072] 10.222.0.43 () {58 vars in 1154 bytes} [Mon Jun 20 18:56:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:56:38.444692 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-dc09bf28-2fea-461b-87a9-d5fdece4a495 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] Calling method '.version_select at 0x7f7e4475e040>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:38.525269 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-dc09bf28-2fea-461b-87a9-d5fdece4a495 tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084747 Jun 20 18:56:38.525841 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 539/1073] 10.222.0.43 () {58 vars in 1187 bytes} [Mon Jun 20 18:56:38 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:38.537295 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-26cc5306-f99b-4966-8f73-b7eb4deca10b tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] Calling method '.version_select at 0x7f7e449dd550>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:38.616715 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-26cc5306-f99b-4966-8f73-b7eb4deca10b tempest-VolumesTestJSON-2060795140 tempest-VolumesTestJSON-2060795140-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083194 Jun 20 18:56:38.617284 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 535/1074] 10.222.0.43 () {58 vars in 1154 bytes} [Mon Jun 20 18:56:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:56:43.336357 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-cf56dfab-e312-472a-a80d-77a2ecd92f17 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Action: 'create', calling method: .version_select at 0x7f7e44a40dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-970387858", "metadata": {"Type": "work"}}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-cf56dfab-e312-472a-a80d-77a2ecd92f17 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Request method failure captured: Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 121 Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMLrn7hHFtg2PO9Ag-aHufBduA3-s9fY930_Vu2_TT1-vnRwXqkAABPJyukoDulAWEdzG6DzRBvYZc1sISffI0ijxQYy1nraqB6tjEO_Ba1CbKVOlkQlzbr7lo2JYp3xlhSs40-yBGGrbEBzLrC5ZDXa_zBJVHyLTHV_sL9Nwxg3sjU Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: b403f9e062a547829419c89262f227b9 Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:56:43.355608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:56:43.357215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b403f9e062a547829419c89262f227b9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b403f9e062a547829419c89262f227b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b403f9e062a547829419c89262f227b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b403f9e062a547829419c89262f227b9"}]}] Jun 20 18:56:43.357215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.357215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: b403f9e062a547829419c89262f227b9 Jun 20 18:56:43.357215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.357215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-VolumesNegativeTest-1924118247-project Jun 20 18:56:43.357215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:56:43.357215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:56:43.357215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 0097f901264842bf971ff6d6e7d31b7c Jun 20 18:56:43.357215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-VolumesNegativeTest-1924118247-project Jun 20 18:56:43.357215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Jun 20 18:56:43.357215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-970387858", "metadata": {"Type": "work"}}} Jun 20 18:56:43.357215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: Jun 20 18:56:43.357215 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-970387858', 'metadata': {'Type': 'work'}}}} Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise error Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi '#$%' Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:43.358271 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 18:56:43.359991 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 18:56:43.361342 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 18:56:43.361342 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.361342 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-cf56dfab-e312-472a-a80d-77a2ecd92f17 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:43.361342 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-cf56dfab-e312-472a-a80d-77a2ecd92f17 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131802 Jun 20 18:56:43.361342 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 540/1075] 10.222.0.43 () {60 vars in 1155 bytes} [Mon Jun 20 18:56:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 18:56:43.367772 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-029dfcd0-29e6-4f46-a8be-0c37a97f9bf7 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Action: 'create', calling method: .version_select at 0x7f7e449dd8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-460278498", "metadata": {"Type": "work"}}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-029dfcd0-29e6-4f46-a8be-0c37a97f9bf7 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Request method failure captured: Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 119 Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMLrn7hHFtg2PO9Ag-aHufBduA3-s9fY930_Vu2_TT1-vnRwXqkAABPJyukoDulAWEdzG6DzRBvYZc1sISffI0ijxQYy1nraqB6tjEO_Ba1CbKVOlkQlzbr7lo2JYp3xlhSs40-yBGGrbEBzLrC5ZDXa_zBJVHyLTHV_sL9Nwxg3sjU Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: b403f9e062a547829419c89262f227b9 Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:56:43.371055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:56:43.372592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b403f9e062a547829419c89262f227b9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b403f9e062a547829419c89262f227b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b403f9e062a547829419c89262f227b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b403f9e062a547829419c89262f227b9"}]}] Jun 20 18:56:43.372592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.372592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: b403f9e062a547829419c89262f227b9 Jun 20 18:56:43.372592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.372592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-VolumesNegativeTest-1924118247-project Jun 20 18:56:43.372592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:56:43.372592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:56:43.372592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 0097f901264842bf971ff6d6e7d31b7c Jun 20 18:56:43.372592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-VolumesNegativeTest-1924118247-project Jun 20 18:56:43.372592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Jun 20 18:56:43.372592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-460278498", "metadata": {"Type": "work"}}} Jun 20 18:56:43.372592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: Jun 20 18:56:43.372592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-460278498', 'metadata': {'Type': 'work'}}}} Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise error Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi '0' Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:43.373568 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 18:56:43.375233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 18:56:43.376541 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 18:56:43.376541 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.376541 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-029dfcd0-29e6-4f46-a8be-0c37a97f9bf7 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:43.376541 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-029dfcd0-29e6-4f46-a8be-0c37a97f9bf7 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009141 Jun 20 18:56:43.376541 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 536/1076] 10.222.0.43 () {60 vars in 1155 bytes} [Mon Jun 20 18:56:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 18:56:43.382312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9d5e4d75-7f28-4833-8620-ffc2fe34266d tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Action: 'create', calling method: .version_select at 0x7f7e44a40dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-685191772", "metadata": {"Type": "work"}}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9d5e4d75-7f28-4833-8620-ffc2fe34266d tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Request method failure captured: Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 118 Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMLrn7hHFtg2PO9Ag-aHufBduA3-s9fY930_Vu2_TT1-vnRwXqkAABPJyukoDulAWEdzG6DzRBvYZc1sISffI0ijxQYy1nraqB6tjEO_Ba1CbKVOlkQlzbr7lo2JYp3xlhSs40-yBGGrbEBzLrC5ZDXa_zBJVHyLTHV_sL9Nwxg3sjU Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: b403f9e062a547829419c89262f227b9 Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:56:43.384565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:56:43.386043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b403f9e062a547829419c89262f227b9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b403f9e062a547829419c89262f227b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b403f9e062a547829419c89262f227b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b403f9e062a547829419c89262f227b9"}]}] Jun 20 18:56:43.386043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.386043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: b403f9e062a547829419c89262f227b9 Jun 20 18:56:43.386043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.386043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-VolumesNegativeTest-1924118247-project Jun 20 18:56:43.386043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:56:43.386043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:56:43.386043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 0097f901264842bf971ff6d6e7d31b7c Jun 20 18:56:43.386043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-VolumesNegativeTest-1924118247-project Jun 20 18:56:43.386043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Jun 20 18:56:43.386043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-685191772", "metadata": {"Type": "work"}}} Jun 20 18:56:43.386043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: Jun 20 18:56:43.386043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-685191772', 'metadata': {'Type': 'work'}}}} Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise error Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi '' Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:43.387010 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 18:56:43.388563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 18:56:43.389862 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 18:56:43.389862 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.389862 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9d5e4d75-7f28-4833-8620-ffc2fe34266d tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:43.389862 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9d5e4d75-7f28-4833-8620-ffc2fe34266d tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008443 Jun 20 18:56:43.389862 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 541/1077] 10.222.0.43 () {60 vars in 1155 bytes} [Mon Jun 20 18:56:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 18:56:43.394854 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5772d21b-8a27-4595-b708-8444d2ff3ead tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Calling method '.version_select at 0x7f7e449b99d0>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:43.422207 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-5772d21b-8a27-4595-b708-8444d2ff3ead tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] HTTP exception thrown: Volume tempest-invalid-1416847139 could not be found. Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5772d21b-8a27-4595-b708-8444d2ff3ead tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Request method failure captured: Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1416847139 HTTP/1.1 Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMLrn7hHFtg2PO9Ag-aHufBduA3-s9fY930_Vu2_TT1-vnRwXqkAABPJyukoDulAWEdzG6DzRBvYZc1sISffI0ijxQYy1nraqB6tjEO_Ba1CbKVOlkQlzbr7lo2JYp3xlhSs40-yBGGrbEBzLrC5ZDXa_zBJVHyLTHV_sL9Nwxg3sjU Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: b403f9e062a547829419c89262f227b9 Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:56:43.424232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:56:43.426371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b403f9e062a547829419c89262f227b9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b403f9e062a547829419c89262f227b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b403f9e062a547829419c89262f227b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b403f9e062a547829419c89262f227b9"}]}] Jun 20 18:56:43.426371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.426371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: b403f9e062a547829419c89262f227b9 Jun 20 18:56:43.426371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.426371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-VolumesNegativeTest-1924118247-project Jun 20 18:56:43.426371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:56:43.426371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:56:43.426371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 0097f901264842bf971ff6d6e7d31b7c Jun 20 18:56:43.426371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-VolumesNegativeTest-1924118247-project Jun 20 18:56:43.426371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: Jun 20 18:56:43.426371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Volume tempest-invalid-1416847139 could not be found. Jun 20 18:56:43.426371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': 'tempest-invalid-1416847139'} Jun 20 18:56:43.426371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1416847139 could not be found. (HTTP 404) (Request-ID: req-a7a9e2e5-60d9-4735-a448-e0099348c2a6) Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.427369 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 18:56:43.428786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1416847139 could not be found. Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:56:43.430036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1416847139 could not be found. Jun 20 18:56:43.431561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.431561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.431561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.431561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.431561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:43.431561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:43.431561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:56:43.431561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:56:43.431561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1416847139 could not be found. Jun 20 18:56:43.431561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.431561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5772d21b-8a27-4595-b708-8444d2ff3ead tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Returning 404 to user: Volume tempest-invalid-1416847139 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:43.431561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5772d21b-8a27-4595-b708-8444d2ff3ead tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1416847139" status: 404 len: 99 microversion: 2.1 time: 0.034896 Jun 20 18:56:43.431561 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 537/1078] 10.222.0.43 () {58 vars in 1217 bytes} [Mon Jun 20 18:56:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1416847139 => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 18:56:43.435448 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6d1e2733-d4cf-420f-9adc-32da22f6be90 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003709 Jun 20 18:56:43.435934 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 542/1079] 10.222.0.43 () {58 vars in 1139 bytes} [Mon Jun 20 18:56:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 18:56:43.444345 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5acdd277-7c19-479b-9d18-1293018d75b6 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004194 Jun 20 18:56:43.444840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 538/1080] 10.222.0.43 () {58 vars in 1136 bytes} [Mon Jun 20 18:56:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 18:56:43.452579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-03683942-a350-4eeb-853a-c25906109315 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Calling method '.version_select at 0x7f7e4475e310>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:43.479408 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-03683942-a350-4eeb-853a-c25906109315 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] HTTP exception thrown: Volume 6c43a293-de66-4f95-b243-b7688c15a7f5 could not be found. Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-03683942-a350-4eeb-853a-c25906109315 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Request method failure captured: Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: DELETE /compute/v2.1/os-volumes/6c43a293-de66-4f95-b243-b7688c15a7f5 HTTP/1.1 Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMLrn7hHFtg2PO9Ag-aHufBduA3-s9fY930_Vu2_TT1-vnRwXqkAABPJyukoDulAWEdzG6DzRBvYZc1sISffI0ijxQYy1nraqB6tjEO_Ba1CbKVOlkQlzbr7lo2JYp3xlhSs40-yBGGrbEBzLrC5ZDXa_zBJVHyLTHV_sL9Nwxg3sjU Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: b403f9e062a547829419c89262f227b9 Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:56:43.481322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:56:43.482895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b403f9e062a547829419c89262f227b9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b403f9e062a547829419c89262f227b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b403f9e062a547829419c89262f227b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b403f9e062a547829419c89262f227b9"}]}] Jun 20 18:56:43.482895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.482895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: b403f9e062a547829419c89262f227b9 Jun 20 18:56:43.482895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.482895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-VolumesNegativeTest-1924118247-project Jun 20 18:56:43.482895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:56:43.482895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:56:43.482895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 0097f901264842bf971ff6d6e7d31b7c Jun 20 18:56:43.482895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-VolumesNegativeTest-1924118247-project Jun 20 18:56:43.482895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: Jun 20 18:56:43.482895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Volume 6c43a293-de66-4f95-b243-b7688c15a7f5 could not be found. Jun 20 18:56:43.482895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '6c43a293-de66-4f95-b243-b7688c15a7f5'} Jun 20 18:56:43.482895 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c43a293-de66-4f95-b243-b7688c15a7f5 could not be found. (HTTP 404) (Request-ID: req-bff06540-585d-4118-aa2f-3e59fc2c41b7) Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.484044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 18:56:43.485395 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c43a293-de66-4f95-b243-b7688c15a7f5 could not be found. Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 18:56:43.486734 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:56:43.488528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c43a293-de66-4f95-b243-b7688c15a7f5 could not be found. Jun 20 18:56:43.488528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.488528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.488528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.488528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.488528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:43.488528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:43.488528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:56:43.488528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:56:43.488528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c43a293-de66-4f95-b243-b7688c15a7f5 could not be found. Jun 20 18:56:43.488528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.488528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-03683942-a350-4eeb-853a-c25906109315 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Returning 404 to user: Volume 6c43a293-de66-4f95-b243-b7688c15a7f5 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:43.488528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-03683942-a350-4eeb-853a-c25906109315 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/6c43a293-de66-4f95-b243-b7688c15a7f5" status: 404 len: 109 microversion: 2.1 time: 0.033510 Jun 20 18:56:43.488528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 543/1081] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jun 20 18:56:43 2022] DELETE /compute/v2.1/os-volumes/6c43a293-de66-4f95-b243-b7688c15a7f5 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:56:43.491941 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5219e982-46f0-46a4-afd3-ebbd21e99450 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Calling method '.version_select at 0x7f7e491ed0d0>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:43.520434 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-5219e982-46f0-46a4-afd3-ebbd21e99450 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] HTTP exception thrown: Volume 501d2379-7365-4a32-8209-39719d06f4f3 could not be found. Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5219e982-46f0-46a4-afd3-ebbd21e99450 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Request method failure captured: Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/os-volumes/501d2379-7365-4a32-8209-39719d06f4f3 HTTP/1.1 Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMLrn7hHFtg2PO9Ag-aHufBduA3-s9fY930_Vu2_TT1-vnRwXqkAABPJyukoDulAWEdzG6DzRBvYZc1sISffI0ijxQYy1nraqB6tjEO_Ba1CbKVOlkQlzbr7lo2JYp3xlhSs40-yBGGrbEBzLrC5ZDXa_zBJVHyLTHV_sL9Nwxg3sjU Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: b403f9e062a547829419c89262f227b9 Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:56:43.522411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:56:43.523957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b403f9e062a547829419c89262f227b9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b403f9e062a547829419c89262f227b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b403f9e062a547829419c89262f227b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b403f9e062a547829419c89262f227b9"}]}] Jun 20 18:56:43.523957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.523957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: b403f9e062a547829419c89262f227b9 Jun 20 18:56:43.523957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-VolumesNegativeTest-1924118247 Jun 20 18:56:43.523957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-VolumesNegativeTest-1924118247-project Jun 20 18:56:43.523957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:56:43.523957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:56:43.523957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 0097f901264842bf971ff6d6e7d31b7c Jun 20 18:56:43.523957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-VolumesNegativeTest-1924118247-project Jun 20 18:56:43.523957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: Jun 20 18:56:43.523957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Volume 501d2379-7365-4a32-8209-39719d06f4f3 could not be found. Jun 20 18:56:43.523957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': '501d2379-7365-4a32-8209-39719d06f4f3'} Jun 20 18:56:43.523957 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 501d2379-7365-4a32-8209-39719d06f4f3 could not be found. (HTTP 404) (Request-ID: req-33d88a62-390f-4fdc-9343-aa9011aa9d98) Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.524936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 18:56:43.526719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 501d2379-7365-4a32-8209-39719d06f4f3 could not be found. Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 18:56:43.528066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:56:43.529430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 501d2379-7365-4a32-8209-39719d06f4f3 could not be found. Jun 20 18:56:43.529430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.529430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:43.529430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.529430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:43.529430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:43.529430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:43.529430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:56:43.529430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:56:43.529430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 501d2379-7365-4a32-8209-39719d06f4f3 could not be found. Jun 20 18:56:43.529430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:43.529430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5219e982-46f0-46a4-afd3-ebbd21e99450 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] Returning 404 to user: Volume 501d2379-7365-4a32-8209-39719d06f4f3 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:43.529430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5219e982-46f0-46a4-afd3-ebbd21e99450 tempest-VolumesNegativeTest-1924118247 tempest-VolumesNegativeTest-1924118247-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/501d2379-7365-4a32-8209-39719d06f4f3" status: 404 len: 109 microversion: 2.1 time: 0.035774 Jun 20 18:56:43.529430 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 539/1082] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jun 20 18:56:43 2022] GET /compute/v2.1/os-volumes/501d2379-7365-4a32-8209-39719d06f4f3 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:56:47.008408 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-17427194-19e6-41d3-803f-6f34a230ff72 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:47.009398 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-17427194-19e6-41d3-803f-6f34a230ff72 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:47.015507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-17427194-19e6-41d3-803f-6f34a230ff72 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:47.015954 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-17427194-19e6-41d3-803f-6f34a230ff72 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:47.016713 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-17427194-19e6-41d3-803f-6f34a230ff72 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:47.017145 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-17427194-19e6-41d3-803f-6f34a230ff72 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:47.047407 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-17427194-19e6-41d3-803f-6f34a230ff72 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045215 Jun 20 18:56:47.047977 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 544/1083] 10.222.0.43 () {60 vars in 1342 bytes} [Mon Jun 20 18:56:47 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:56:47.110135 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c9a2cbb6-e8cb-44b2-84e8-6b90736a013b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:47.110672 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c9a2cbb6-e8cb-44b2-84e8-6b90736a013b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:47.117631 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c9a2cbb6-e8cb-44b2-84e8-6b90736a013b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:47.118081 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c9a2cbb6-e8cb-44b2-84e8-6b90736a013b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:47.118848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c9a2cbb6-e8cb-44b2-84e8-6b90736a013b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:47.119312 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c9a2cbb6-e8cb-44b2-84e8-6b90736a013b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:47.143965 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c9a2cbb6-e8cb-44b2-84e8-6b90736a013b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:56:47.183245 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f17f4634-2943-4d5f-94ee-16856f4744fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:47.184212 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f17f4634-2943-4d5f-94ee-16856f4744fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:47.190967 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f17f4634-2943-4d5f-94ee-16856f4744fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:47.191270 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f17f4634-2943-4d5f-94ee-16856f4744fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:47.192155 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f17f4634-2943-4d5f-94ee-16856f4744fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:47.192634 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f17f4634-2943-4d5f-94ee-16856f4744fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:47.227385 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c9a2cbb6-e8cb-44b2-84e8-6b90736a013b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 204 len: 0 microversion: 2.20 time: 0.122241 Jun 20 18:56:47.228173 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 540/1084] 10.222.0.43 () {60 vars in 1279 bytes} [Mon Jun 20 18:56:47 2022] DELETE /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 18:56:47.234511 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f17f4634-2943-4d5f-94ee-16856f4744fa tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a/ips" status: 200 len: 148 microversion: 2.1 time: 0.055358 Jun 20 18:56:47.238006 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-21e66bcc-ed3d-440c-b27b-da168d8a7a91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:47.238797 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-21e66bcc-ed3d-440c-b27b-da168d8a7a91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:47.242381 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 545/1085] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jun 20 18:56:47 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a/ips => generated 148 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:47.244843 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-21e66bcc-ed3d-440c-b27b-da168d8a7a91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:47.245294 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-21e66bcc-ed3d-440c-b27b-da168d8a7a91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:47.246065 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-21e66bcc-ed3d-440c-b27b-da168d8a7a91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:47.246482 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-21e66bcc-ed3d-440c-b27b-da168d8a7a91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:47.385467 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-21e66bcc-ed3d-440c-b27b-da168d8a7a91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:47.393517 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-21e66bcc-ed3d-440c-b27b-da168d8a7a91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:47.395199 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-21e66bcc-ed3d-440c-b27b-da168d8a7a91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:47.396387 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-21e66bcc-ed3d-440c-b27b-da168d8a7a91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1724 microversion: 2.20 time: 0.163345 Jun 20 18:56:47.396932 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 541/1086] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:56:47 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:56:48.415496 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a429889a-e71a-48aa-84f1-bf70c58737c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:48.416110 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a429889a-e71a-48aa-84f1-bf70c58737c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:48.423219 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a429889a-e71a-48aa-84f1-bf70c58737c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:48.423670 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a429889a-e71a-48aa-84f1-bf70c58737c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:48.425080 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a429889a-e71a-48aa-84f1-bf70c58737c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:48.425371 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a429889a-e71a-48aa-84f1-bf70c58737c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:48.560666 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a429889a-e71a-48aa-84f1-bf70c58737c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:48.581983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a429889a-e71a-48aa-84f1-bf70c58737c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:48.584124 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a6a8ff8c-8516-4853-a1c7-02858ee166bb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d2be024-d7a5-4891-bc23-51f4f8b068f2"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:56:48.585216 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a6a8ff8c-8516-4853-a1c7-02858ee166bb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:48.587209 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a429889a-e71a-48aa-84f1-bf70c58737c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:48.588966 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a429889a-e71a-48aa-84f1-bf70c58737c9 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1724 microversion: 2.20 time: 0.177422 Jun 20 18:56:48.589661 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 546/1087] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:56:48 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 18:56:48.592807 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a6a8ff8c-8516-4853-a1c7-02858ee166bb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:48.593263 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a6a8ff8c-8516-4853-a1c7-02858ee166bb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:48.594042 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a6a8ff8c-8516-4853-a1c7-02858ee166bb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:48.594480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a6a8ff8c-8516-4853-a1c7-02858ee166bb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:49.018605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a6a8ff8c-8516-4853-a1c7-02858ee166bb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "POST /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.438422 Jun 20 18:56:49.019276 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 542/1088] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jun 20 18:56:48 2022] POST /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a/os-volume_attachments => generated 194 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 18:56:49.612630 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-9664c1da-d7ff-4487-a9f2-85ca69eaae6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:49.613600 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-9664c1da-d7ff-4487-a9f2-85ca69eaae6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:49.629949 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9664c1da-d7ff-4487-a9f2-85ca69eaae6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:49.630940 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9664c1da-d7ff-4487-a9f2-85ca69eaae6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:49.631216 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9664c1da-d7ff-4487-a9f2-85ca69eaae6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:49.631654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-9664c1da-d7ff-4487-a9f2-85ca69eaae6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:49.728024 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9664c1da-d7ff-4487-a9f2-85ca69eaae6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:49.736134 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9664c1da-d7ff-4487-a9f2-85ca69eaae6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:49.737725 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-9664c1da-d7ff-4487-a9f2-85ca69eaae6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60a36e18710443359ba2a56ad2810043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4944c36091d4f5f84e06386ee5a1589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:49.739108 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-9664c1da-d7ff-4487-a9f2-85ca69eaae6b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 200 len: 1656 microversion: 2.20 time: 0.134197 Jun 20 18:56:49.739650 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 547/1089] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:56:49 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 1656 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 18:56:50.011088 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-bca82707-ceab-4370-83bb-d0a12b5f47b2 req-76d38448-0f2b-43d0-83b5-fd582929fa26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb97000-4705-4f02-bdd0-00047a203abf", "name": "network-vif-deleted", "tag": "d20d672a-4e79-42b8-b764-55a554f24b8b"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:56:50.027818 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-bca82707-ceab-4370-83bb-d0a12b5f47b2 req-76d38448-0f2b-43d0-83b5-fd582929fa26 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:50.028305 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-bca82707-ceab-4370-83bb-d0a12b5f47b2 req-76d38448-0f2b-43d0-83b5-fd582929fa26 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:50.046527 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-bca82707-ceab-4370-83bb-d0a12b5f47b2 req-76d38448-0f2b-43d0-83b5-fd582929fa26 service nova] Creating event network-vif-deleted:d20d672a-4e79-42b8-b764-55a554f24b8b for instance dcb97000-4705-4f02-bdd0-00047a203abf on hv-cinder-83697 Jun 20 18:56:50.052623 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-bca82707-ceab-4370-83bb-d0a12b5f47b2 req-76d38448-0f2b-43d0-83b5-fd582929fa26 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045726 Jun 20 18:56:50.054065 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 543/1090] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:50.758179 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-bb9da9ae-985b-4a58-af61-7134addc521c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:50.758982 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-bb9da9ae-985b-4a58-af61-7134addc521c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:50.765401 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bb9da9ae-985b-4a58-af61-7134addc521c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:50.765916 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bb9da9ae-985b-4a58-af61-7134addc521c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:50.766899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bb9da9ae-985b-4a58-af61-7134addc521c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:50.767488 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bb9da9ae-985b-4a58-af61-7134addc521c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:50.781244 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-bb9da9ae-985b-4a58-af61-7134addc521c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] HTTP exception thrown: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-bb9da9ae-985b-4a58-af61-7134addc521c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Request method failure captured: Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf HTTP/1.1 Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMB0jVacf4SMGHCrPlaiukJzg18XCdGsZ5l5-w2UHN4b4FxdP_mw-vNB2f8yzj8VNmocAK62qA_Af9FQtR_DvaSkHjgDmqI9y3AiuDYK-bDZRSC2T5bWbaaAxi5pCIIL_cYwH-H3ImotSvJ45IxeA48zk0Q-HFZ9g_yfU23_dgExA7g Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: b4944c36091d4f5f84e06386ee5a1589 Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:56:50.782867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:56:50.784644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b4944c36091d4f5f84e06386ee5a1589", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b4944c36091d4f5f84e06386ee5a1589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b4944c36091d4f5f84e06386ee5a1589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b4944c36091d4f5f84e06386ee5a1589"}]}] Jun 20 18:56:50.784644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:50.784644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: b4944c36091d4f5f84e06386ee5a1589 Jun 20 18:56:50.784644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:50.784644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-AttachVolumeShelveTestJSON-356597947-project Jun 20 18:56:50.784644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:56:50.784644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:56:50.784644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 60a36e18710443359ba2a56ad2810043 Jun 20 18:56:50.784644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-AttachVolumeShelveTestJSON-356597947-project Jun 20 18:56:50.784644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:56:50.784644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:50.784644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': 'dcb97000-4705-4f02-bdd0-00047a203abf'} Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:50.785509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:50.787000 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:50.788312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-bb9da9ae-985b-4a58-af61-7134addc521c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Returning 404 to user: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:50.788312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-bb9da9ae-985b-4a58-af61-7134addc521c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 404 len: 111 microversion: 2.20 time: 0.030735 Jun 20 18:56:50.788312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 548/1091] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:56:50 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 18:56:50.794487 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-138821f4-f798-4ddb-ba0b-2a0b653a046c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '.version_select at 0x7f7e449b9280>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:50.815154 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-138821f4-f798-4ddb-ba0b-2a0b653a046c tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-786175635" status: 204 len: 0 microversion: 2.20 time: 0.024871 Jun 20 18:56:50.816456 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 544/1092] 10.222.0.43 () {60 vars in 1258 bytes} [Mon Jun 20 18:56:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-786175635 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 18:56:52.881404 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ff0baf07-3e20-478d-8f82-a94ec5802a8b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:52.881882 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ff0baf07-3e20-478d-8f82-a94ec5802a8b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:52.888764 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ff0baf07-3e20-478d-8f82-a94ec5802a8b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:52.889213 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ff0baf07-3e20-478d-8f82-a94ec5802a8b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:52.889975 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ff0baf07-3e20-478d-8f82-a94ec5802a8b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:52.890408 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ff0baf07-3e20-478d-8f82-a94ec5802a8b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:52.904050 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-ff0baf07-3e20-478d-8f82-a94ec5802a8b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] HTTP exception thrown: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ff0baf07-3e20-478d-8f82-a94ec5802a8b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Request method failure captured: Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: DELETE /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf HTTP/1.1 Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMB0jVacf4SMGHCrPlaiukJzg18XCdGsZ5l5-w2UHN4b4FxdP_mw-vNB2f8yzj8VNmocAK62qA_Af9FQtR_DvaSkHjgDmqI9y3AiuDYK-bDZRSC2T5bWbaaAxi5pCIIL_cYwH-H3ImotSvJ45IxeA48zk0Q-HFZ9g_yfU23_dgExA7g Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: b4944c36091d4f5f84e06386ee5a1589 Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:56:52.905598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:56:52.907111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b4944c36091d4f5f84e06386ee5a1589", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b4944c36091d4f5f84e06386ee5a1589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b4944c36091d4f5f84e06386ee5a1589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b4944c36091d4f5f84e06386ee5a1589"}]}] Jun 20 18:56:52.907111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:52.907111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: b4944c36091d4f5f84e06386ee5a1589 Jun 20 18:56:52.907111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:52.907111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-AttachVolumeShelveTestJSON-356597947-project Jun 20 18:56:52.907111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:56:52.907111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:56:52.907111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 60a36e18710443359ba2a56ad2810043 Jun 20 18:56:52.907111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-AttachVolumeShelveTestJSON-356597947-project Jun 20 18:56:52.907111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:56:52.907111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:52.907111 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': 'dcb97000-4705-4f02-bdd0-00047a203abf'} Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:52.907860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:52.909099 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:52.910447 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ff0baf07-3e20-478d-8f82-a94ec5802a8b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Returning 404 to user: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:52.910447 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ff0baf07-3e20-478d-8f82-a94ec5802a8b tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 404 len: 111 microversion: 2.20 time: 0.030153 Jun 20 18:56:52.910447 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 549/1093] 10.222.0.43 () {60 vars in 1279 bytes} [Mon Jun 20 18:56:52 2022] DELETE /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 18:56:52.917320 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ff200140-7bd0-4039-ae7f-7e992f4f37bf tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:52.918082 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ff200140-7bd0-4039-ae7f-7e992f4f37bf tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: dcb97000-4705-4f02-bdd0-00047a203abf] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:52.927253 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ff200140-7bd0-4039-ae7f-7e992f4f37bf tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:52.927694 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ff200140-7bd0-4039-ae7f-7e992f4f37bf tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:52.928457 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ff200140-7bd0-4039-ae7f-7e992f4f37bf tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:52.928887 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ff200140-7bd0-4039-ae7f-7e992f4f37bf tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:52.942812 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-ff200140-7bd0-4039-ae7f-7e992f4f37bf tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] HTTP exception thrown: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ff200140-7bd0-4039-ae7f-7e992f4f37bf tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Request method failure captured: Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf HTTP/1.1 Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMB0jVacf4SMGHCrPlaiukJzg18XCdGsZ5l5-w2UHN4b4FxdP_mw-vNB2f8yzj8VNmocAK62qA_Af9FQtR_DvaSkHjgDmqI9y3AiuDYK-bDZRSC2T5bWbaaAxi5pCIIL_cYwH-H3ImotSvJ45IxeA48zk0Q-HFZ9g_yfU23_dgExA7g Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: b4944c36091d4f5f84e06386ee5a1589 Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:56:52.944514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:56:52.945958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b4944c36091d4f5f84e06386ee5a1589", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b4944c36091d4f5f84e06386ee5a1589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b4944c36091d4f5f84e06386ee5a1589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b4944c36091d4f5f84e06386ee5a1589"}]}] Jun 20 18:56:52.945958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:52.945958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: b4944c36091d4f5f84e06386ee5a1589 Jun 20 18:56:52.945958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:52.945958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-AttachVolumeShelveTestJSON-356597947-project Jun 20 18:56:52.945958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:56:52.945958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:56:52.945958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 60a36e18710443359ba2a56ad2810043 Jun 20 18:56:52.945958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-AttachVolumeShelveTestJSON-356597947-project Jun 20 18:56:52.945958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:56:52.945958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:52.945958 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': 'dcb97000-4705-4f02-bdd0-00047a203abf'} Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:52.946776 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. Jun 20 18:56:52.948105 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:52.949264 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ff200140-7bd0-4039-ae7f-7e992f4f37bf tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Returning 404 to user: Instance dcb97000-4705-4f02-bdd0-00047a203abf could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:52.949264 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ff200140-7bd0-4039-ae7f-7e992f4f37bf tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf" status: 404 len: 111 microversion: 2.20 time: 0.033495 Jun 20 18:56:52.949264 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 545/1094] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:56:52 2022] GET /compute/v2.1/servers/dcb97000-4705-4f02-bdd0-00047a203abf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 18:56:54.083929 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1e9d2423-870f-4e9f-b90e-4e163933bdb0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:54.084416 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1e9d2423-870f-4e9f-b90e-4e163933bdb0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:54.090899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1e9d2423-870f-4e9f-b90e-4e163933bdb0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:54.091373 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1e9d2423-870f-4e9f-b90e-4e163933bdb0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:54.092117 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1e9d2423-870f-4e9f-b90e-4e163933bdb0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:54.092540 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1e9d2423-870f-4e9f-b90e-4e163933bdb0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:54.105951 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-1e9d2423-870f-4e9f-b90e-4e163933bdb0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] HTTP exception thrown: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1e9d2423-870f-4e9f-b90e-4e163933bdb0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Request method failure captured: Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: DELETE /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 HTTP/1.1 Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMB0jVacf4SMGHCrPlaiukJzg18XCdGsZ5l5-w2UHN4b4FxdP_mw-vNB2f8yzj8VNmocAK62qA_Af9FQtR_DvaSkHjgDmqI9y3AiuDYK-bDZRSC2T5bWbaaAxi5pCIIL_cYwH-H3ImotSvJ45IxeA48zk0Q-HFZ9g_yfU23_dgExA7g Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: b4944c36091d4f5f84e06386ee5a1589 Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:56:54.107507 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:56:54.109176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b4944c36091d4f5f84e06386ee5a1589", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b4944c36091d4f5f84e06386ee5a1589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b4944c36091d4f5f84e06386ee5a1589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b4944c36091d4f5f84e06386ee5a1589"}]}] Jun 20 18:56:54.109176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:54.109176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: b4944c36091d4f5f84e06386ee5a1589 Jun 20 18:56:54.109176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:54.109176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-AttachVolumeShelveTestJSON-356597947-project Jun 20 18:56:54.109176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:56:54.109176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:56:54.109176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 60a36e18710443359ba2a56ad2810043 Jun 20 18:56:54.109176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-AttachVolumeShelveTestJSON-356597947-project Jun 20 18:56:54.109176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:56:54.109176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:56:54.109176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': 'aa52c387-5b77-4644-85c8-691b22dfeb78'} Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:54.110067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:56:54.111542 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:56:54.113545 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1e9d2423-870f-4e9f-b90e-4e163933bdb0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Returning 404 to user: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:54.113545 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1e9d2423-870f-4e9f-b90e-4e163933bdb0 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "DELETE /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 404 len: 111 microversion: 2.20 time: 0.028846 Jun 20 18:56:54.113545 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 550/1095] 10.222.0.43 () {60 vars in 1279 bytes} [Mon Jun 20 18:56:54 2022] DELETE /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 18:56:54.117617 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8dedc573-95d5-404e-a2e9-6251c3de3e91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:54.118217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8dedc573-95d5-404e-a2e9-6251c3de3e91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] [instance: aa52c387-5b77-4644-85c8-691b22dfeb78] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:54.124576 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8dedc573-95d5-404e-a2e9-6251c3de3e91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:54.125016 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8dedc573-95d5-404e-a2e9-6251c3de3e91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:54.125763 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8dedc573-95d5-404e-a2e9-6251c3de3e91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:54.126191 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8dedc573-95d5-404e-a2e9-6251c3de3e91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:54.138981 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-8dedc573-95d5-404e-a2e9-6251c3de3e91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] HTTP exception thrown: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8dedc573-95d5-404e-a2e9-6251c3de3e91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Request method failure captured: Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 HTTP/1.1 Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMB0jVacf4SMGHCrPlaiukJzg18XCdGsZ5l5-w2UHN4b4FxdP_mw-vNB2f8yzj8VNmocAK62qA_Af9FQtR_DvaSkHjgDmqI9y3AiuDYK-bDZRSC2T5bWbaaAxi5pCIIL_cYwH-H3ImotSvJ45IxeA48zk0Q-HFZ9g_yfU23_dgExA7g Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: b4944c36091d4f5f84e06386ee5a1589 Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:56:54.140479 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:56:54.142072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b4944c36091d4f5f84e06386ee5a1589", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b4944c36091d4f5f84e06386ee5a1589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b4944c36091d4f5f84e06386ee5a1589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b4944c36091d4f5f84e06386ee5a1589"}]}] Jun 20 18:56:54.142072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:54.142072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: b4944c36091d4f5f84e06386ee5a1589 Jun 20 18:56:54.142072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-356597947 Jun 20 18:56:54.142072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-AttachVolumeShelveTestJSON-356597947-project Jun 20 18:56:54.142072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:56:54.142072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:56:54.142072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 60a36e18710443359ba2a56ad2810043 Jun 20 18:56:54.142072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-AttachVolumeShelveTestJSON-356597947-project Jun 20 18:56:54.142072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:56:54.142072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:56:54.142072 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': 'aa52c387-5b77-4644-85c8-691b22dfeb78'} Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:56:54.142897 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. Jun 20 18:56:54.144122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:56:54.145187 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8dedc573-95d5-404e-a2e9-6251c3de3e91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] Returning 404 to user: Instance aa52c387-5b77-4644-85c8-691b22dfeb78 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:56:54.145187 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8dedc573-95d5-404e-a2e9-6251c3de3e91 tempest-AttachVolumeShelveTestJSON-356597947 tempest-AttachVolumeShelveTestJSON-356597947-project] 10.222.0.43 "GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78" status: 404 len: 111 microversion: 2.20 time: 0.028004 Jun 20 18:56:54.145187 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 546/1096] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jun 20 18:56:54 2022] GET /compute/v2.1/servers/aa52c387-5b77-4644-85c8-691b22dfeb78 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 18:56:56.738770 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3293ec47-af17-4531-b72d-15b08727b4b0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:56.739346 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-3293ec47-af17-4531-b72d-15b08727b4b0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:56.747630 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3293ec47-af17-4531-b72d-15b08727b4b0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:56.748089 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3293ec47-af17-4531-b72d-15b08727b4b0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:56.748874 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3293ec47-af17-4531-b72d-15b08727b4b0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:56.749370 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3293ec47-af17-4531-b72d-15b08727b4b0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:56.872620 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-3293ec47-af17-4531-b72d-15b08727b4b0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lazy-loading 'services' on Instance uuid e3cd7486-00ce-4ee1-a280-48d2720f8d0a {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:56:56.957030 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-3293ec47-af17-4531-b72d-15b08727b4b0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a/os-volume_attachments/6d2be024-d7a5-4891-bc23-51f4f8b068f2" status: 202 len: 0 microversion: 2.1 time: 0.222007 Jun 20 18:56:56.962287 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 551/1097] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jun 20 18:56:56 2022] DELETE /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a/os-volume_attachments/6d2be024-d7a5-4891-bc23-51f4f8b068f2 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:56:56.973147 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5d6a50c7-a254-4107-863b-dcbd8b7fa1eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:56.974087 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5d6a50c7-a254-4107-863b-dcbd8b7fa1eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:56.986360 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5d6a50c7-a254-4107-863b-dcbd8b7fa1eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:56.986672 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5d6a50c7-a254-4107-863b-dcbd8b7fa1eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:56.989205 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5d6a50c7-a254-4107-863b-dcbd8b7fa1eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:56.990204 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5d6a50c7-a254-4107-863b-dcbd8b7fa1eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:57.026380 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5d6a50c7-a254-4107-863b-dcbd8b7fa1eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064279 Jun 20 18:56:57.027388 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 547/1098] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:56:56 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:56:58.039764 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-254af059-af7b-4476-b818-b3ef226218eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:58.041110 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-254af059-af7b-4476-b818-b3ef226218eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:58.047579 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-254af059-af7b-4476-b818-b3ef226218eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:58.048030 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-254af059-af7b-4476-b818-b3ef226218eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:58.048791 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-254af059-af7b-4476-b818-b3ef226218eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:58.049220 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-254af059-af7b-4476-b818-b3ef226218eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:58.081522 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-254af059-af7b-4476-b818-b3ef226218eb tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046414 Jun 20 18:56:58.082393 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 552/1099] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jun 20 18:56:58 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 18:56:58.141557 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8ea1d1da-6918-47b5-a0a7-77a275d6dfb8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:58.142059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8ea1d1da-6918-47b5-a0a7-77a275d6dfb8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:58.148763 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8ea1d1da-6918-47b5-a0a7-77a275d6dfb8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:58.149213 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8ea1d1da-6918-47b5-a0a7-77a275d6dfb8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:58.150080 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8ea1d1da-6918-47b5-a0a7-77a275d6dfb8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:58.150520 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8ea1d1da-6918-47b5-a0a7-77a275d6dfb8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:58.176674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8ea1d1da-6918-47b5-a0a7-77a275d6dfb8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:56:58.260740 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8ea1d1da-6918-47b5-a0a7-77a275d6dfb8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 204 len: 0 microversion: 2.1 time: 0.122825 Jun 20 18:56:58.261506 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 548/1100] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:56:58 2022] DELETE /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:56:58.269294 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6a2254f1-2fff-4020-87c4-155e6a7fcca4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:58.269896 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6a2254f1-2fff-4020-87c4-155e6a7fcca4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:58.275984 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6a2254f1-2fff-4020-87c4-155e6a7fcca4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:58.276421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6a2254f1-2fff-4020-87c4-155e6a7fcca4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:58.277361 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6a2254f1-2fff-4020-87c4-155e6a7fcca4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:58.277791 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6a2254f1-2fff-4020-87c4-155e6a7fcca4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:58.409446 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6a2254f1-2fff-4020-87c4-155e6a7fcca4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:58.419434 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6a2254f1-2fff-4020-87c4-155e6a7fcca4 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1680 microversion: 2.1 time: 0.153646 Jun 20 18:56:58.420327 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 553/1101] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:56:58 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:56:59.437132 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0affe2cb-b686-4857-abc1-27220e492ae0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:56:59.437864 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0affe2cb-b686-4857-abc1-27220e492ae0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:56:59.447449 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0affe2cb-b686-4857-abc1-27220e492ae0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:59.448028 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0affe2cb-b686-4857-abc1-27220e492ae0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:59.449228 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0affe2cb-b686-4857-abc1-27220e492ae0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:56:59.449673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0affe2cb-b686-4857-abc1-27220e492ae0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:56:59.589343 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-0affe2cb-b686-4857-abc1-27220e492ae0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:56:59.597941 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0affe2cb-b686-4857-abc1-27220e492ae0 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1680 microversion: 2.1 time: 0.165048 Jun 20 18:56:59.598560 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 549/1102] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:56:59 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:57:00.615695 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-2e86f63f-2533-4a89-b2c8-848bc90d1f46 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:00.616299 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-2e86f63f-2533-4a89-b2c8-848bc90d1f46 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:00.622822 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2e86f63f-2533-4a89-b2c8-848bc90d1f46 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:00.623294 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2e86f63f-2533-4a89-b2c8-848bc90d1f46 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:00.624042 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2e86f63f-2533-4a89-b2c8-848bc90d1f46 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:00.624477 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2e86f63f-2533-4a89-b2c8-848bc90d1f46 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:00.754709 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-2e86f63f-2533-4a89-b2c8-848bc90d1f46 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:57:00.762141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-2e86f63f-2533-4a89-b2c8-848bc90d1f46 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1680 microversion: 2.1 time: 0.150976 Jun 20 18:57:00.762694 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 554/1103] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:00 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:57:01.780141 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8880cbe3-9415-4fd9-b8f1-6da25e3ecb7c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:01.780759 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8880cbe3-9415-4fd9-b8f1-6da25e3ecb7c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:01.787806 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8880cbe3-9415-4fd9-b8f1-6da25e3ecb7c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:01.788256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8880cbe3-9415-4fd9-b8f1-6da25e3ecb7c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:01.789021 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8880cbe3-9415-4fd9-b8f1-6da25e3ecb7c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:01.789461 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8880cbe3-9415-4fd9-b8f1-6da25e3ecb7c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:01.919081 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8880cbe3-9415-4fd9-b8f1-6da25e3ecb7c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:57:01.926985 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8880cbe3-9415-4fd9-b8f1-6da25e3ecb7c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1680 microversion: 2.1 time: 0.150753 Jun 20 18:57:01.927546 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 550/1104] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:01 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:57:02.944273 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-dc843af8-82c1-4e79-bc2f-518c65814368 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:02.944836 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-dc843af8-82c1-4e79-bc2f-518c65814368 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:02.951615 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-dc843af8-82c1-4e79-bc2f-518c65814368 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:02.952064 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-dc843af8-82c1-4e79-bc2f-518c65814368 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:02.952826 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-dc843af8-82c1-4e79-bc2f-518c65814368 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:02.953264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-dc843af8-82c1-4e79-bc2f-518c65814368 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:03.113039 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-dc843af8-82c1-4e79-bc2f-518c65814368 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:57:03.121067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-dc843af8-82c1-4e79-bc2f-518c65814368 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1680 microversion: 2.1 time: 0.180897 Jun 20 18:57:03.121640 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 555/1105] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:02 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:57:04.138659 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b86bae02-4572-4614-9a46-db826cf8e505 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:04.139298 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b86bae02-4572-4614-9a46-db826cf8e505 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:04.146314 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b86bae02-4572-4614-9a46-db826cf8e505 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:04.146760 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b86bae02-4572-4614-9a46-db826cf8e505 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:04.147574 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b86bae02-4572-4614-9a46-db826cf8e505 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:04.148006 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b86bae02-4572-4614-9a46-db826cf8e505 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:04.285621 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b86bae02-4572-4614-9a46-db826cf8e505 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:57:04.294187 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b86bae02-4572-4614-9a46-db826cf8e505 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1680 microversion: 2.1 time: 0.159351 Jun 20 18:57:04.294945 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 551/1106] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:04 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:57:05.311157 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-44c68454-a089-4fed-b1a1-e1d7b4f40c05 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:05.311761 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-44c68454-a089-4fed-b1a1-e1d7b4f40c05 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:05.318610 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44c68454-a089-4fed-b1a1-e1d7b4f40c05 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:05.319203 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44c68454-a089-4fed-b1a1-e1d7b4f40c05 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:05.320261 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44c68454-a089-4fed-b1a1-e1d7b4f40c05 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:05.320690 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-44c68454-a089-4fed-b1a1-e1d7b4f40c05 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:05.463929 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-44c68454-a089-4fed-b1a1-e1d7b4f40c05 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:57:05.476917 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-44c68454-a089-4fed-b1a1-e1d7b4f40c05 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1680 microversion: 2.1 time: 0.169530 Jun 20 18:57:05.477494 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 556/1107] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:05 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:57:06.494286 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7c05b71c-a739-4731-be87-aac7e5d7cb62 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:06.494894 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7c05b71c-a739-4731-be87-aac7e5d7cb62 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:06.501356 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c05b71c-a739-4731-be87-aac7e5d7cb62 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:06.501833 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c05b71c-a739-4731-be87-aac7e5d7cb62 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:06.502597 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c05b71c-a739-4731-be87-aac7e5d7cb62 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:06.503674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c05b71c-a739-4731-be87-aac7e5d7cb62 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:06.645120 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7c05b71c-a739-4731-be87-aac7e5d7cb62 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:57:06.652963 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7c05b71c-a739-4731-be87-aac7e5d7cb62 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1680 microversion: 2.1 time: 0.162615 Jun 20 18:57:06.653609 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 552/1108] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:06 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:57:07.673693 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6be4e0ee-31c0-43b7-b3e8-64d70f5b2326 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:07.674636 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6be4e0ee-31c0-43b7-b3e8-64d70f5b2326 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:07.681966 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6be4e0ee-31c0-43b7-b3e8-64d70f5b2326 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:07.682417 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6be4e0ee-31c0-43b7-b3e8-64d70f5b2326 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:07.683517 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6be4e0ee-31c0-43b7-b3e8-64d70f5b2326 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:07.683955 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6be4e0ee-31c0-43b7-b3e8-64d70f5b2326 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:07.934426 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6be4e0ee-31c0-43b7-b3e8-64d70f5b2326 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:57:07.942394 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6be4e0ee-31c0-43b7-b3e8-64d70f5b2326 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1680 microversion: 2.1 time: 0.276563 Jun 20 18:57:07.942979 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 557/1109] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:07 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1680 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:57:08.680829 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-8c797686-6ab5-4758-90f9-c31ac41379f3 req-a6bbdac8-6a6b-45ac-bcb3-faee2625bdde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3cd7486-00ce-4ee1-a280-48d2720f8d0a", "name": "network-vif-deleted", "tag": "cfb96e54-b9ce-42bf-8b8d-34ef813c73bc"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:57:08.692057 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:08.694014 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-8c797686-6ab5-4758-90f9-c31ac41379f3 req-a6bbdac8-6a6b-45ac-bcb3-faee2625bdde service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:08.694831 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-8c797686-6ab5-4758-90f9-c31ac41379f3 req-a6bbdac8-6a6b-45ac-bcb3-faee2625bdde service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:08.700971 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:08.713536 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-8c797686-6ab5-4758-90f9-c31ac41379f3 req-a6bbdac8-6a6b-45ac-bcb3-faee2625bdde service nova] Creating event network-vif-deleted:cfb96e54-b9ce-42bf-8b8d-34ef813c73bc for instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a on hv-cinder-83697 Jun 20 18:57:08.722683 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-8c797686-6ab5-4758-90f9-c31ac41379f3 req-a6bbdac8-6a6b-45ac-bcb3-faee2625bdde service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045620 Jun 20 18:57:08.723502 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 553/1110] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:57:08.960781 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-325eb0b7-275c-4232-91eb-15680713b4f8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:08.962075 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-325eb0b7-275c-4232-91eb-15680713b4f8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:08.969012 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-325eb0b7-275c-4232-91eb-15680713b4f8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:08.969456 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-325eb0b7-275c-4232-91eb-15680713b4f8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:08.970212 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-325eb0b7-275c-4232-91eb-15680713b4f8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:08.970639 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-325eb0b7-275c-4232-91eb-15680713b4f8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:09.003685 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-325eb0b7-275c-4232-91eb-15680713b4f8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:09.004123 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-325eb0b7-275c-4232-91eb-15680713b4f8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:09.004562 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-325eb0b7-275c-4232-91eb-15680713b4f8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lazy-loading 'fault' on Instance uuid e3cd7486-00ce-4ee1-a280-48d2720f8d0a {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:57:09.048560 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-325eb0b7-275c-4232-91eb-15680713b4f8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:57:09.060442 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-325eb0b7-275c-4232-91eb-15680713b4f8 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1331 microversion: 2.1 time: 0.104317 Jun 20 18:57:09.061387 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 558/1111] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:08 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:57:10.078293 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-a55fc838-30e3-4a90-8180-d3be7f7694ba tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:10.079030 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-a55fc838-30e3-4a90-8180-d3be7f7694ba tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:10.088606 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a55fc838-30e3-4a90-8180-d3be7f7694ba tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:10.089055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a55fc838-30e3-4a90-8180-d3be7f7694ba tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:10.089818 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a55fc838-30e3-4a90-8180-d3be7f7694ba tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:10.090256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a55fc838-30e3-4a90-8180-d3be7f7694ba tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:10.121693 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a55fc838-30e3-4a90-8180-d3be7f7694ba tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:10.122127 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-a55fc838-30e3-4a90-8180-d3be7f7694ba tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:10.122596 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-a55fc838-30e3-4a90-8180-d3be7f7694ba tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lazy-loading 'fault' on Instance uuid e3cd7486-00ce-4ee1-a280-48d2720f8d0a {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:57:10.165483 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-a55fc838-30e3-4a90-8180-d3be7f7694ba tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:57:10.173208 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-a55fc838-30e3-4a90-8180-d3be7f7694ba tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1331 microversion: 2.1 time: 0.099169 Jun 20 18:57:10.173756 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 554/1112] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:10 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:57:11.189563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-be0a4b43-2256-4ee6-8341-c300add6159b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:11.190230 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-be0a4b43-2256-4ee6-8341-c300add6159b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:11.197093 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-be0a4b43-2256-4ee6-8341-c300add6159b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:11.197538 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-be0a4b43-2256-4ee6-8341-c300add6159b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:11.198289 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-be0a4b43-2256-4ee6-8341-c300add6159b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:11.198719 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-be0a4b43-2256-4ee6-8341-c300add6159b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:11.230690 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-be0a4b43-2256-4ee6-8341-c300add6159b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:11.231177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-be0a4b43-2256-4ee6-8341-c300add6159b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:11.231620 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.objects.instance [None req-be0a4b43-2256-4ee6-8341-c300add6159b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lazy-loading 'fault' on Instance uuid e3cd7486-00ce-4ee1-a280-48d2720f8d0a {{(pid=124189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:57:11.273994 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-be0a4b43-2256-4ee6-8341-c300add6159b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:57:11.281323 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-be0a4b43-2256-4ee6-8341-c300add6159b tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1331 microversion: 2.1 time: 0.095579 Jun 20 18:57:11.281875 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 559/1113] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:11 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:57:12.297795 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5e983286-75ea-4234-baa9-159e32a3de7d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:12.298428 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5e983286-75ea-4234-baa9-159e32a3de7d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:12.304837 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5e983286-75ea-4234-baa9-159e32a3de7d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:12.305279 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5e983286-75ea-4234-baa9-159e32a3de7d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:12.306036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5e983286-75ea-4234-baa9-159e32a3de7d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:12.306462 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5e983286-75ea-4234-baa9-159e32a3de7d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:12.337729 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5e983286-75ea-4234-baa9-159e32a3de7d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:12.338172 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5e983286-75ea-4234-baa9-159e32a3de7d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:12.338620 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-5e983286-75ea-4234-baa9-159e32a3de7d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lazy-loading 'fault' on Instance uuid e3cd7486-00ce-4ee1-a280-48d2720f8d0a {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:57:12.382702 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5e983286-75ea-4234-baa9-159e32a3de7d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3134832f2a647aab761da347f7e9fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8006d78bc1604611b3254b5efa451288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:57:12.390121 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5e983286-75ea-4234-baa9-159e32a3de7d tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 200 len: 1331 microversion: 2.1 time: 0.096195 Jun 20 18:57:12.390674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 555/1114] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:12 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:57:13.406928 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-2d19b8ce-4773-43f3-ba36-28c0aa00e721 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:13.407533 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-2d19b8ce-4773-43f3-ba36-28c0aa00e721 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:13.414495 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2d19b8ce-4773-43f3-ba36-28c0aa00e721 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:13.414958 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2d19b8ce-4773-43f3-ba36-28c0aa00e721 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:13.415703 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2d19b8ce-4773-43f3-ba36-28c0aa00e721 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:13.416379 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-2d19b8ce-4773-43f3-ba36-28c0aa00e721 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:13.429502 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-2d19b8ce-4773-43f3-ba36-28c0aa00e721 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] HTTP exception thrown: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-2d19b8ce-4773-43f3-ba36-28c0aa00e721 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Request method failure captured: Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a HTTP/1.1 Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMB7oKpb5ufs7k91aATNwQ9lBCFsAiscF2D6zDu63Pdu1lDJfudYPQfg-WIoWYQQ-JgV04sOxsJj7QlSIQrKVCkKsbiXYH3d8jdfXZNL0OxCyUpor2PA81B48M0Ll8y0cg4uK3b5-fQlEg3o6bUpvXP-E4SmBiu6KFl4dytZBttHh-M Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:57:13.431128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:57:13.432698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8006d78bc1604611b3254b5efa451288", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8006d78bc1604611b3254b5efa451288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}] Jun 20 18:57:13.432698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:13.432698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:13.432698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:13.432698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:13.432698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:57:13.432698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:57:13.432698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: c3134832f2a647aab761da347f7e9fd4 Jun 20 18:57:13.432698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:13.432698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:57:13.432698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:13.432698 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': 'e3cd7486-00ce-4ee1-a280-48d2720f8d0a'} Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:57:13.433530 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:13.435150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:13.436465 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-2d19b8ce-4773-43f3-ba36-28c0aa00e721 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Returning 404 to user: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:57:13.436465 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-2d19b8ce-4773-43f3-ba36-28c0aa00e721 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 404 len: 111 microversion: 2.1 time: 0.029427 Jun 20 18:57:13.436465 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 560/1115] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:13 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:57:13.441320 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-708fec65-3c87-4ce2-92dc-016c39aec79c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '.version_select at 0x7f7e449b6ca0>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:13.461688 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-708fec65-3c87-4ce2-92dc-016c39aec79c tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-704521901" status: 202 len: 0 microversion: 2.1 time: 0.024374 Jun 20 18:57:13.462267 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 556/1116] 10.222.0.43 () {58 vars in 1217 bytes} [Mon Jun 20 18:57:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-704521901 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 18:57:15.226130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f601a31f-0176-4434-8225-7c82aa06afd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:15.226641 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-f601a31f-0176-4434-8225-7c82aa06afd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:15.232964 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f601a31f-0176-4434-8225-7c82aa06afd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:15.233402 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f601a31f-0176-4434-8225-7c82aa06afd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:15.234147 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f601a31f-0176-4434-8225-7c82aa06afd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:15.234568 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-f601a31f-0176-4434-8225-7c82aa06afd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:15.248473 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-f601a31f-0176-4434-8225-7c82aa06afd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] HTTP exception thrown: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f601a31f-0176-4434-8225-7c82aa06afd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Request method failure captured: Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: DELETE /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a HTTP/1.1 Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMB7oKpb5ufs7k91aATNwQ9lBCFsAiscF2D6zDu63Pdu1lDJfudYPQfg-WIoWYQQ-JgV04sOxsJj7QlSIQrKVCkKsbiXYH3d8jdfXZNL0OxCyUpor2PA81B48M0Ll8y0cg4uK3b5-fQlEg3o6bUpvXP-E4SmBiu6KFl4dytZBttHh-M Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:57:15.250013 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:57:15.251587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8006d78bc1604611b3254b5efa451288", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8006d78bc1604611b3254b5efa451288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}] Jun 20 18:57:15.251587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:15.251587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:15.251587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:15.251587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:15.251587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:57:15.251587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:57:15.251587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: c3134832f2a647aab761da347f7e9fd4 Jun 20 18:57:15.251587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:15.251587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:57:15.251587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:15.251587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': 'e3cd7486-00ce-4ee1-a280-48d2720f8d0a'} Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:57:15.252453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:15.253931 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:15.255434 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-f601a31f-0176-4434-8225-7c82aa06afd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Returning 404 to user: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:57:15.255434 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-f601a31f-0176-4434-8225-7c82aa06afd6 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 404 len: 111 microversion: 2.1 time: 0.029031 Jun 20 18:57:15.255434 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 561/1117] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:57:15 2022] DELETE /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:57:15.259655 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1bf8bfbc-808f-49cf-8c9c-60f273edc45f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:15.260267 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1bf8bfbc-808f-49cf-8c9c-60f273edc45f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: e3cd7486-00ce-4ee1-a280-48d2720f8d0a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:15.267459 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1bf8bfbc-808f-49cf-8c9c-60f273edc45f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:15.267927 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1bf8bfbc-808f-49cf-8c9c-60f273edc45f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:15.268751 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1bf8bfbc-808f-49cf-8c9c-60f273edc45f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:15.269183 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1bf8bfbc-808f-49cf-8c9c-60f273edc45f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:15.281973 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-1bf8bfbc-808f-49cf-8c9c-60f273edc45f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] HTTP exception thrown: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1bf8bfbc-808f-49cf-8c9c-60f273edc45f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Request method failure captured: Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a HTTP/1.1 Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMB7oKpb5ufs7k91aATNwQ9lBCFsAiscF2D6zDu63Pdu1lDJfudYPQfg-WIoWYQQ-JgV04sOxsJj7QlSIQrKVCkKsbiXYH3d8jdfXZNL0OxCyUpor2PA81B48M0Ll8y0cg4uK3b5-fQlEg3o6bUpvXP-E4SmBiu6KFl4dytZBttHh-M Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:57:15.283657 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:57:15.285723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8006d78bc1604611b3254b5efa451288", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8006d78bc1604611b3254b5efa451288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}] Jun 20 18:57:15.285723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:15.285723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:15.285723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:15.285723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:15.285723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:57:15.285723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:57:15.285723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: c3134832f2a647aab761da347f7e9fd4 Jun 20 18:57:15.285723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:15.285723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:57:15.285723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:15.285723 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': 'e3cd7486-00ce-4ee1-a280-48d2720f8d0a'} Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:57:15.286605 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. Jun 20 18:57:15.288067 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:15.289343 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1bf8bfbc-808f-49cf-8c9c-60f273edc45f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Returning 404 to user: Instance e3cd7486-00ce-4ee1-a280-48d2720f8d0a could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:57:15.289343 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1bf8bfbc-808f-49cf-8c9c-60f273edc45f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a" status: 404 len: 111 microversion: 2.1 time: 0.029726 Jun 20 18:57:15.289343 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 557/1118] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:15 2022] GET /compute/v2.1/servers/e3cd7486-00ce-4ee1-a280-48d2720f8d0a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:57:16.417448 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4668e39a-7b21-4fcf-9522-b7e06141d27f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:16.417937 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-4668e39a-7b21-4fcf-9522-b7e06141d27f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:16.423909 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4668e39a-7b21-4fcf-9522-b7e06141d27f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:16.424347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4668e39a-7b21-4fcf-9522-b7e06141d27f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:16.425586 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4668e39a-7b21-4fcf-9522-b7e06141d27f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:16.426011 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4668e39a-7b21-4fcf-9522-b7e06141d27f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:16.439029 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-4668e39a-7b21-4fcf-9522-b7e06141d27f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] HTTP exception thrown: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4668e39a-7b21-4fcf-9522-b7e06141d27f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Request method failure captured: Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: DELETE /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 HTTP/1.1 Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMB7oKpb5ufs7k91aATNwQ9lBCFsAiscF2D6zDu63Pdu1lDJfudYPQfg-WIoWYQQ-JgV04sOxsJj7QlSIQrKVCkKsbiXYH3d8jdfXZNL0OxCyUpor2PA81B48M0Ll8y0cg4uK3b5-fQlEg3o6bUpvXP-E4SmBiu6KFl4dytZBttHh-M Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:57:16.441279 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:57:16.442856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8006d78bc1604611b3254b5efa451288", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8006d78bc1604611b3254b5efa451288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}] Jun 20 18:57:16.442856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:16.442856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:16.442856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:16.442856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:16.442856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:57:16.442856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:57:16.442856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: c3134832f2a647aab761da347f7e9fd4 Jun 20 18:57:16.442856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:16.442856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:57:16.442856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:57:16.442856 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '3d279054-6318-480a-a1d1-2c4a46085141'} Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:57:16.443820 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:57:16.445421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.446865 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4668e39a-7b21-4fcf-9522-b7e06141d27f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Returning 404 to user: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:57:16.446865 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4668e39a-7b21-4fcf-9522-b7e06141d27f tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 404 len: 111 microversion: 2.1 time: 0.029356 Jun 20 18:57:16.446865 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 562/1119] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:57:16 2022] DELETE /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:57:16.450873 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0946bf42-bc7c-406f-a787-df523e9b9eed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:16.451518 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0946bf42-bc7c-406f-a787-df523e9b9eed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 3d279054-6318-480a-a1d1-2c4a46085141] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:16.457987 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0946bf42-bc7c-406f-a787-df523e9b9eed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:16.458425 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0946bf42-bc7c-406f-a787-df523e9b9eed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:16.459202 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0946bf42-bc7c-406f-a787-df523e9b9eed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:16.459631 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0946bf42-bc7c-406f-a787-df523e9b9eed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:16.472978 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-0946bf42-bc7c-406f-a787-df523e9b9eed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] HTTP exception thrown: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0946bf42-bc7c-406f-a787-df523e9b9eed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Request method failure captured: Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 HTTP/1.1 Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMB7oKpb5ufs7k91aATNwQ9lBCFsAiscF2D6zDu63Pdu1lDJfudYPQfg-WIoWYQQ-JgV04sOxsJj7QlSIQrKVCkKsbiXYH3d8jdfXZNL0OxCyUpor2PA81B48M0Ll8y0cg4uK3b5-fQlEg3o6bUpvXP-E4SmBiu6KFl4dytZBttHh-M Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:57:16.474468 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:57:16.476059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8006d78bc1604611b3254b5efa451288", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8006d78bc1604611b3254b5efa451288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}] Jun 20 18:57:16.476059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:16.476059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:16.476059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:16.476059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:16.476059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:57:16.476059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:57:16.476059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: c3134832f2a647aab761da347f7e9fd4 Jun 20 18:57:16.476059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:16.476059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:57:16.476059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:57:16.476059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': '3d279054-6318-480a-a1d1-2c4a46085141'} Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:57:16.476930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. Jun 20 18:57:16.478486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.479822 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0946bf42-bc7c-406f-a787-df523e9b9eed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Returning 404 to user: Instance 3d279054-6318-480a-a1d1-2c4a46085141 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:57:16.479822 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0946bf42-bc7c-406f-a787-df523e9b9eed tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141" status: 404 len: 111 microversion: 2.1 time: 0.028869 Jun 20 18:57:16.479822 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 558/1120] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:16 2022] GET /compute/v2.1/servers/3d279054-6318-480a-a1d1-2c4a46085141 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:57:16.488329 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3c103ae7-ca9b-4eeb-9eaf-75101e10ef97 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:16.488793 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-3c103ae7-ca9b-4eeb-9eaf-75101e10ef97 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:16.494874 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3c103ae7-ca9b-4eeb-9eaf-75101e10ef97 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:16.495346 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3c103ae7-ca9b-4eeb-9eaf-75101e10ef97 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:16.496103 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3c103ae7-ca9b-4eeb-9eaf-75101e10ef97 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:16.496534 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3c103ae7-ca9b-4eeb-9eaf-75101e10ef97 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:16.509690 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-3c103ae7-ca9b-4eeb-9eaf-75101e10ef97 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] HTTP exception thrown: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3c103ae7-ca9b-4eeb-9eaf-75101e10ef97 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Request method failure captured: Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: DELETE /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 HTTP/1.1 Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMB7oKpb5ufs7k91aATNwQ9lBCFsAiscF2D6zDu63Pdu1lDJfudYPQfg-WIoWYQQ-JgV04sOxsJj7QlSIQrKVCkKsbiXYH3d8jdfXZNL0OxCyUpor2PA81B48M0Ll8y0cg4uK3b5-fQlEg3o6bUpvXP-E4SmBiu6KFl4dytZBttHh-M Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:57:16.511256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:57:16.512805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8006d78bc1604611b3254b5efa451288", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8006d78bc1604611b3254b5efa451288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}] Jun 20 18:57:16.512805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:16.512805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:16.512805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:16.512805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:16.512805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:57:16.512805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:57:16.512805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: c3134832f2a647aab761da347f7e9fd4 Jun 20 18:57:16.512805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:16.512805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:57:16.512805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:57:16.512805 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '6efd07f2-b56d-4cc1-8187-d6d3afca2c86'} Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:57:16.515978 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:57:16.518573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.520067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3c103ae7-ca9b-4eeb-9eaf-75101e10ef97 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Returning 404 to user: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:57:16.520067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-3c103ae7-ca9b-4eeb-9eaf-75101e10ef97 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 404 len: 111 microversion: 2.1 time: 0.028684 Jun 20 18:57:16.520067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 563/1121] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:57:16 2022] DELETE /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:57:16.521135 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d1e58bed-f4eb-4308-90b6-b330dbaa2c06 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:16.521738 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-d1e58bed-f4eb-4308-90b6-b330dbaa2c06 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: 6efd07f2-b56d-4cc1-8187-d6d3afca2c86] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:16.527693 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d1e58bed-f4eb-4308-90b6-b330dbaa2c06 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:16.528133 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d1e58bed-f4eb-4308-90b6-b330dbaa2c06 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:16.528878 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d1e58bed-f4eb-4308-90b6-b330dbaa2c06 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:16.529336 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-d1e58bed-f4eb-4308-90b6-b330dbaa2c06 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:16.543051 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-d1e58bed-f4eb-4308-90b6-b330dbaa2c06 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] HTTP exception thrown: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d1e58bed-f4eb-4308-90b6-b330dbaa2c06 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Request method failure captured: Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 HTTP/1.1 Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMB7oKpb5ufs7k91aATNwQ9lBCFsAiscF2D6zDu63Pdu1lDJfudYPQfg-WIoWYQQ-JgV04sOxsJj7QlSIQrKVCkKsbiXYH3d8jdfXZNL0OxCyUpor2PA81B48M0Ll8y0cg4uK3b5-fQlEg3o6bUpvXP-E4SmBiu6KFl4dytZBttHh-M Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:57:16.544550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:57:16.546221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8006d78bc1604611b3254b5efa451288", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8006d78bc1604611b3254b5efa451288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}] Jun 20 18:57:16.546221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:16.546221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:16.546221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:16.546221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:16.546221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:57:16.546221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:57:16.546221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: c3134832f2a647aab761da347f7e9fd4 Jun 20 18:57:16.546221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:16.546221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:57:16.546221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:57:16.546221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': '6efd07f2-b56d-4cc1-8187-d6d3afca2c86'} Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:57:16.547142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. Jun 20 18:57:16.549096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:16.551203 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-d1e58bed-f4eb-4308-90b6-b330dbaa2c06 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Returning 404 to user: Instance 6efd07f2-b56d-4cc1-8187-d6d3afca2c86 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:57:16.551203 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-d1e58bed-f4eb-4308-90b6-b330dbaa2c06 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86" status: 404 len: 111 microversion: 2.1 time: 0.031097 Jun 20 18:57:16.551203 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 559/1122] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:16 2022] GET /compute/v2.1/servers/6efd07f2-b56d-4cc1-8187-d6d3afca2c86 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:57:17.686438 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c59973ff-0bfb-479f-9dcd-d1c56505f583 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:17.687003 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c59973ff-0bfb-479f-9dcd-d1c56505f583 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:17.689670 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=45 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:17.697075 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c59973ff-0bfb-479f-9dcd-d1c56505f583 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:17.697561 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c59973ff-0bfb-479f-9dcd-d1c56505f583 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:17.698394 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c59973ff-0bfb-479f-9dcd-d1c56505f583 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:17.698829 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c59973ff-0bfb-479f-9dcd-d1c56505f583 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:17.713543 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:17.715014 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-c59973ff-0bfb-479f-9dcd-d1c56505f583 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] HTTP exception thrown: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c59973ff-0bfb-479f-9dcd-d1c56505f583 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Request method failure captured: Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: DELETE /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a HTTP/1.1 Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMB7oKpb5ufs7k91aATNwQ9lBCFsAiscF2D6zDu63Pdu1lDJfudYPQfg-WIoWYQQ-JgV04sOxsJj7QlSIQrKVCkKsbiXYH3d8jdfXZNL0OxCyUpor2PA81B48M0Ll8y0cg4uK3b5-fQlEg3o6bUpvXP-E4SmBiu6KFl4dytZBttHh-M Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:57:17.716867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:57:17.718264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8006d78bc1604611b3254b5efa451288", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8006d78bc1604611b3254b5efa451288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}] Jun 20 18:57:17.718264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:17.718264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:17.718264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:17.718264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:17.718264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:57:17.718264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:57:17.718264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: c3134832f2a647aab761da347f7e9fd4 Jun 20 18:57:17.718264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:17.718264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:57:17.718264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:57:17.718264 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': 'bf3d4888-1358-407b-9677-a8887d92ea3a'} Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:57:17.721985 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:57:17.724163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:57:17.726485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c59973ff-0bfb-479f-9dcd-d1c56505f583 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Returning 404 to user: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:57:17.726485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c59973ff-0bfb-479f-9dcd-d1c56505f583 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 404 len: 111 microversion: 2.1 time: 0.035863 Jun 20 18:57:17.726485 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 564/1123] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:57:17 2022] DELETE /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:57:17.727528 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-02800658-6468-410f-96ee-2a2df3e32cd3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:57:17.729055 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-02800658-6468-410f-96ee-2a2df3e32cd3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] [instance: bf3d4888-1358-407b-9677-a8887d92ea3a] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:57:17.736663 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-02800658-6468-410f-96ee-2a2df3e32cd3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:17.737644 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-02800658-6468-410f-96ee-2a2df3e32cd3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:17.738690 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-02800658-6468-410f-96ee-2a2df3e32cd3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:57:17.739230 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-02800658-6468-410f-96ee-2a2df3e32cd3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:57:17.757595 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-02800658-6468-410f-96ee-2a2df3e32cd3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] HTTP exception thrown: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-02800658-6468-410f-96ee-2a2df3e32cd3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Request method failure captured: Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a HTTP/1.1 Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMB7oKpb5ufs7k91aATNwQ9lBCFsAiscF2D6zDu63Pdu1lDJfudYPQfg-WIoWYQQ-JgV04sOxsJj7QlSIQrKVCkKsbiXYH3d8jdfXZNL0OxCyUpor2PA81B48M0Ll8y0cg4uK3b5-fQlEg3o6bUpvXP-E4SmBiu6KFl4dytZBttHh-M Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 18:57:17.759470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 18:57:17.760956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8006d78bc1604611b3254b5efa451288", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8006d78bc1604611b3254b5efa451288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8006d78bc1604611b3254b5efa451288"}]}] Jun 20 18:57:17.760956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:17.760956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: 8006d78bc1604611b3254b5efa451288 Jun 20 18:57:17.760956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1886623161 Jun 20 18:57:17.760956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:17.760956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 18:57:17.760956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 18:57:17.760956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: c3134832f2a647aab761da347f7e9fd4 Jun 20 18:57:17.760956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-AttachVolumeNegativeTest-1886623161-project Jun 20 18:57:17.760956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 18:57:17.760956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:57:17.760956 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': 'bf3d4888-1358-407b-9677-a8887d92ea3a'} Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:57:17.761866 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. Jun 20 18:57:17.763967 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 18:57:17.766675 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-02800658-6468-410f-96ee-2a2df3e32cd3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] Returning 404 to user: Instance bf3d4888-1358-407b-9677-a8887d92ea3a could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:57:17.766675 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-02800658-6468-410f-96ee-2a2df3e32cd3 tempest-AttachVolumeNegativeTest-1886623161 tempest-AttachVolumeNegativeTest-1886623161-project] 10.222.0.43 "GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a" status: 404 len: 111 microversion: 2.1 time: 0.037874 Jun 20 18:57:17.766675 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 560/1124] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:57:17 2022] GET /compute/v2.1/servers/bf3d4888-1358-407b-9677-a8887d92ea3a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:58:00.947112 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 18:58:00.947801 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Mon Jun 20 18:58:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 18:58:01.519137 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 18:58:01.519663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Mon Jun 20 18:58:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 18:58:41.553067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=1 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:41.557189 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1096064950", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "networks": [{"uuid": "70ed52e2-c895-4710-8f51-1d04f1233d8d"}]}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:58:41.610591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.network.neutron [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] validate_networks() for [('70ed52e2-c895-4710-8f51-1d04f1233d8d', None, None, None, None, None)] {{(pid=124189) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:58:42.005184 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Flavor limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:58:42.005603 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Image limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:58:42.006073 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Flavor pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:58:42.006475 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Image pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:58:42.006879 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:58:42.015654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:42.016098 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:42.016891 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:42.017322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:42.033954 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Getting quotas for project b47706a33b164b94addea95a97469862. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:58:42.037828 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Getting quotas for user e00450cf0f954232bcabaac6c6d84b3c and project b47706a33b164b94addea95a97469862. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:58:42.049233 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Going to run 1 instances... {{(pid=124189) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:58:42.051471 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124189) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:58:42.096640 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e5e4672b-3bca-44b3-949c-9a54346d195c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544937 Jun 20 18:58:42.097269 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 565/1125] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:58:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:58:42.105059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:42.105790 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=25 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:42.110660 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f9381033-e26a-4313-8202-c593983f8784 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:42.111279 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f9381033-e26a-4313-8202-c593983f8784 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:42.166900 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f9381033-e26a-4313-8202-c593983f8784 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:42.175273 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f9381033-e26a-4313-8202-c593983f8784 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 200 len: 1214 microversion: 2.1 time: 0.072057 Jun 20 18:58:42.175819 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 561/1126] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:42 2022] GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:43.192753 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1b01b1d9-87ec-4a4b-b4d9-0eefcf360408 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:43.193360 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1b01b1d9-87ec-4a4b-b4d9-0eefcf360408 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:43.201252 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1b01b1d9-87ec-4a4b-b4d9-0eefcf360408 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:43.201948 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1b01b1d9-87ec-4a4b-b4d9-0eefcf360408 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:43.202719 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1b01b1d9-87ec-4a4b-b4d9-0eefcf360408 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:43.204046 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1b01b1d9-87ec-4a4b-b4d9-0eefcf360408 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:43.284910 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1b01b1d9-87ec-4a4b-b4d9-0eefcf360408 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:43.292454 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1b01b1d9-87ec-4a4b-b4d9-0eefcf360408 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 200 len: 1284 microversion: 2.1 time: 0.104233 Jun 20 18:58:43.293074 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 566/1127] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:43 2022] GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:44.309762 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c70906c4-84db-481c-b667-282c4fa513ef tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:44.310611 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c70906c4-84db-481c-b667-282c4fa513ef tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:44.317353 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c70906c4-84db-481c-b667-282c4fa513ef tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:44.317804 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c70906c4-84db-481c-b667-282c4fa513ef tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:44.318613 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c70906c4-84db-481c-b667-282c4fa513ef tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:44.319084 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c70906c4-84db-481c-b667-282c4fa513ef tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:44.449640 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c70906c4-84db-481c-b667-282c4fa513ef tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:44.458179 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c70906c4-84db-481c-b667-282c4fa513ef tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 200 len: 1314 microversion: 2.1 time: 0.152215 Jun 20 18:58:44.458594 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 562/1128] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:44 2022] GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:44.680778 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-b652a7f5-596d-483a-a48a-5fcc26e6cbaf req-05e71fc9-ac7a-4cbc-bcd4-9148287cc3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b2bc33-10f9-4930-9600-b2fc850360f6", "tag": "39b9b243-4337-48a8-9a4b-7c9a22720752"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:58:44.688835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-b652a7f5-596d-483a-a48a-5fcc26e6cbaf req-05e71fc9-ac7a-4cbc-bcd4-9148287cc3c6 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:44.689345 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-b652a7f5-596d-483a-a48a-5fcc26e6cbaf req-05e71fc9-ac7a-4cbc-bcd4-9148287cc3c6 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:44.700928 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-b652a7f5-596d-483a-a48a-5fcc26e6cbaf req-05e71fc9-ac7a-4cbc-bcd4-9148287cc3c6 service nova] Creating event network-changed:39b9b243-4337-48a8-9a4b-7c9a22720752 for instance 08b2bc33-10f9-4930-9600-b2fc850360f6 on hv-cinder-83697 Jun 20 18:58:44.706425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-b652a7f5-596d-483a-a48a-5fcc26e6cbaf req-05e71fc9-ac7a-4cbc-bcd4-9148287cc3c6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204455 Jun 20 18:58:44.707120 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 567/1129] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:58:45.474904 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-19096009-0d2c-4242-8531-9ff1636a59e6 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:45.475581 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-19096009-0d2c-4242-8531-9ff1636a59e6 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:45.481935 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-19096009-0d2c-4242-8531-9ff1636a59e6 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:45.482381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-19096009-0d2c-4242-8531-9ff1636a59e6 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:45.483166 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-19096009-0d2c-4242-8531-9ff1636a59e6 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:45.483606 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-19096009-0d2c-4242-8531-9ff1636a59e6 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:45.609256 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-19096009-0d2c-4242-8531-9ff1636a59e6 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:45.617189 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-19096009-0d2c-4242-8531-9ff1636a59e6 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 200 len: 1314 microversion: 2.1 time: 0.146747 Jun 20 18:58:45.617736 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 563/1130] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:45 2022] GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:46.635399 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d37c79eb-03e0-4c31-a014-9cbe83ef514f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:46.636085 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d37c79eb-03e0-4c31-a014-9cbe83ef514f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:46.642165 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d37c79eb-03e0-4c31-a014-9cbe83ef514f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:46.642604 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d37c79eb-03e0-4c31-a014-9cbe83ef514f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:46.643399 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d37c79eb-03e0-4c31-a014-9cbe83ef514f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:46.643824 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d37c79eb-03e0-4c31-a014-9cbe83ef514f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:46.804216 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d37c79eb-03e0-4c31-a014-9cbe83ef514f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:46.811835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d37c79eb-03e0-4c31-a014-9cbe83ef514f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 200 len: 1314 microversion: 2.1 time: 0.181163 Jun 20 18:58:46.812390 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 568/1131] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:46 2022] GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:47.828559 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-62033c72-897b-487e-86d7-d35e9241248e tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:47.829167 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-62033c72-897b-487e-86d7-d35e9241248e tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:47.836212 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-62033c72-897b-487e-86d7-d35e9241248e tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:47.836659 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-62033c72-897b-487e-86d7-d35e9241248e tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:47.837413 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-62033c72-897b-487e-86d7-d35e9241248e tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:47.837845 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-62033c72-897b-487e-86d7-d35e9241248e tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:47.967133 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-62033c72-897b-487e-86d7-d35e9241248e tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:47.974527 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-62033c72-897b-487e-86d7-d35e9241248e tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 200 len: 1314 microversion: 2.1 time: 0.149841 Jun 20 18:58:47.975103 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 564/1132] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:47 2022] GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:48.991247 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-18f313c7-c801-4584-81d9-efda192a3f25 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:48.991850 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-18f313c7-c801-4584-81d9-efda192a3f25 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:48.998399 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-18f313c7-c801-4584-81d9-efda192a3f25 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:48.998847 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-18f313c7-c801-4584-81d9-efda192a3f25 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:48.999643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-18f313c7-c801-4584-81d9-efda192a3f25 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:49.000070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-18f313c7-c801-4584-81d9-efda192a3f25 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:49.125539 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-18f313c7-c801-4584-81d9-efda192a3f25 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:49.133360 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-18f313c7-c801-4584-81d9-efda192a3f25 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 200 len: 1314 microversion: 2.1 time: 0.145991 Jun 20 18:58:49.133913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 569/1133] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:48 2022] GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:50.119589 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-66938031-5013-4f78-819a-19bccc2984d5 req-f5a507a9-682d-4eb4-b5e4-b998c73f42ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b2bc33-10f9-4930-9600-b2fc850360f6", "name": "network-vif-plugged", "status": "completed", "tag": "39b9b243-4337-48a8-9a4b-7c9a22720752"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:58:50.127903 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-66938031-5013-4f78-819a-19bccc2984d5 req-f5a507a9-682d-4eb4-b5e4-b998c73f42ba service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:50.128339 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-66938031-5013-4f78-819a-19bccc2984d5 req-f5a507a9-682d-4eb4-b5e4-b998c73f42ba service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:50.139332 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-66938031-5013-4f78-819a-19bccc2984d5 req-f5a507a9-682d-4eb4-b5e4-b998c73f42ba service nova] Creating event network-vif-plugged:39b9b243-4337-48a8-9a4b-7c9a22720752 for instance 08b2bc33-10f9-4930-9600-b2fc850360f6 on hv-cinder-83697 Jun 20 18:58:50.145631 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-66938031-5013-4f78-819a-19bccc2984d5 req-f5a507a9-682d-4eb4-b5e4-b998c73f42ba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091905 Jun 20 18:58:50.146214 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 565/1134] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:58:50.150313 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6520b373-ca6c-43ec-814e-1466d1beb9ce tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:50.150965 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6520b373-ca6c-43ec-814e-1466d1beb9ce tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:50.157334 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6520b373-ca6c-43ec-814e-1466d1beb9ce tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:50.157771 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6520b373-ca6c-43ec-814e-1466d1beb9ce tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:50.158514 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6520b373-ca6c-43ec-814e-1466d1beb9ce tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:50.158959 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6520b373-ca6c-43ec-814e-1466d1beb9ce tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:50.288973 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6520b373-ca6c-43ec-814e-1466d1beb9ce tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:50.296634 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6520b373-ca6c-43ec-814e-1466d1beb9ce tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 200 len: 1314 microversion: 2.1 time: 0.150236 Jun 20 18:58:50.297188 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 570/1135] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:50 2022] GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:51.313827 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9a24e639-197f-4ddb-a336-53dac134df14 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:51.314516 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9a24e639-197f-4ddb-a336-53dac134df14 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:51.321791 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9a24e639-197f-4ddb-a336-53dac134df14 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:51.322232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9a24e639-197f-4ddb-a336-53dac134df14 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:51.323011 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9a24e639-197f-4ddb-a336-53dac134df14 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:51.323443 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9a24e639-197f-4ddb-a336-53dac134df14 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:51.450619 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9a24e639-197f-4ddb-a336-53dac134df14 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:51.459004 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9a24e639-197f-4ddb-a336-53dac134df14 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 200 len: 1314 microversion: 2.1 time: 0.149297 Jun 20 18:58:51.459582 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 566/1136] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:51 2022] GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:52.476589 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-bf5e83b4-9d35-446b-9364-817031225dcc tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:52.477203 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-bf5e83b4-9d35-446b-9364-817031225dcc tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:52.479620 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:52.480322 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=6 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:52.486349 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bf5e83b4-9d35-446b-9364-817031225dcc tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:52.486795 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bf5e83b4-9d35-446b-9364-817031225dcc tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:52.487591 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bf5e83b4-9d35-446b-9364-817031225dcc tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:52.488024 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-bf5e83b4-9d35-446b-9364-817031225dcc tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:52.616654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-bf5e83b4-9d35-446b-9364-817031225dcc tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:52.624024 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-bf5e83b4-9d35-446b-9364-817031225dcc tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 200 len: 1498 microversion: 2.1 time: 0.151914 Jun 20 18:58:52.624583 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 571/1137] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:52 2022] GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:53.046069 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9e6b1a9a-f095-4e87-9dfb-0c3f62b9e1b0 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:53.046563 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9e6b1a9a-f095-4e87-9dfb-0c3f62b9e1b0 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:53.048764 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:53.054204 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9e6b1a9a-f095-4e87-9dfb-0c3f62b9e1b0 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:53.054659 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9e6b1a9a-f095-4e87-9dfb-0c3f62b9e1b0 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:53.055445 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9e6b1a9a-f095-4e87-9dfb-0c3f62b9e1b0 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:53.055876 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9e6b1a9a-f095-4e87-9dfb-0c3f62b9e1b0 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:53.081241 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9e6b1a9a-f095-4e87-9dfb-0c3f62b9e1b0 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:58:53.156132 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9e6b1a9a-f095-4e87-9dfb-0c3f62b9e1b0 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "DELETE /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 204 len: 0 microversion: 2.1 time: 0.114175 Jun 20 18:58:53.156977 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 567/1138] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:58:53 2022] DELETE /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:58:53.165093 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-21863e36-ab01-4009-8d27-1f3cb5bd9506 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:53.165700 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-21863e36-ab01-4009-8d27-1f3cb5bd9506 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:53.172007 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-21863e36-ab01-4009-8d27-1f3cb5bd9506 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:53.172453 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-21863e36-ab01-4009-8d27-1f3cb5bd9506 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:53.173206 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-21863e36-ab01-4009-8d27-1f3cb5bd9506 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:53.173639 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-21863e36-ab01-4009-8d27-1f3cb5bd9506 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:53.303741 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-21863e36-ab01-4009-8d27-1f3cb5bd9506 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:53.311102 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-21863e36-ab01-4009-8d27-1f3cb5bd9506 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 200 len: 1504 microversion: 2.1 time: 0.149812 Jun 20 18:58:53.311657 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 572/1139] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:53 2022] GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:54.329822 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c2ab4279-a31f-454b-9d1b-12bd6617962c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:54.330526 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c2ab4279-a31f-454b-9d1b-12bd6617962c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:54.336992 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c2ab4279-a31f-454b-9d1b-12bd6617962c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:54.337439 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c2ab4279-a31f-454b-9d1b-12bd6617962c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:54.338214 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c2ab4279-a31f-454b-9d1b-12bd6617962c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:54.338650 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c2ab4279-a31f-454b-9d1b-12bd6617962c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:54.469971 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c2ab4279-a31f-454b-9d1b-12bd6617962c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:54.477924 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c2ab4279-a31f-454b-9d1b-12bd6617962c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 200 len: 1504 microversion: 2.1 time: 0.152484 Jun 20 18:58:54.478474 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 568/1140] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:54 2022] GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:55.381443 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-17eec4f4-d4eb-4391-bdee-631d8a515b88 req-3b8d94cf-f447-4f02-9b0c-9d7e3606f45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b2bc33-10f9-4930-9600-b2fc850360f6", "name": "network-vif-deleted", "tag": "39b9b243-4337-48a8-9a4b-7c9a22720752"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:58:55.390411 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-17eec4f4-d4eb-4391-bdee-631d8a515b88 req-3b8d94cf-f447-4f02-9b0c-9d7e3606f45c service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:55.390848 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-17eec4f4-d4eb-4391-bdee-631d8a515b88 req-3b8d94cf-f447-4f02-9b0c-9d7e3606f45c service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:55.401937 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-17eec4f4-d4eb-4391-bdee-631d8a515b88 req-3b8d94cf-f447-4f02-9b0c-9d7e3606f45c service nova] Creating event network-vif-deleted:39b9b243-4337-48a8-9a4b-7c9a22720752 for instance 08b2bc33-10f9-4930-9600-b2fc850360f6 on hv-cinder-83697 Jun 20 18:58:55.407573 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-17eec4f4-d4eb-4391-bdee-631d8a515b88 req-3b8d94cf-f447-4f02-9b0c-9d7e3606f45c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029685 Jun 20 18:58:55.408110 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 573/1141] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:58:55.494322 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9f3e0d8c-f826-4840-8c12-6374d741f7ca tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:55.494935 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9f3e0d8c-f826-4840-8c12-6374d741f7ca tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:55.501318 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9f3e0d8c-f826-4840-8c12-6374d741f7ca tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:55.501847 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9f3e0d8c-f826-4840-8c12-6374d741f7ca tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:55.502632 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9f3e0d8c-f826-4840-8c12-6374d741f7ca tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:55.503092 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9f3e0d8c-f826-4840-8c12-6374d741f7ca tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:55.535889 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9f3e0d8c-f826-4840-8c12-6374d741f7ca tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:55.536362 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9f3e0d8c-f826-4840-8c12-6374d741f7ca tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:55.536802 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-9f3e0d8c-f826-4840-8c12-6374d741f7ca tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lazy-loading 'fault' on Instance uuid 08b2bc33-10f9-4930-9600-b2fc850360f6 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:58:55.579005 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-9f3e0d8c-f826-4840-8c12-6374d741f7ca tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:55.586763 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9f3e0d8c-f826-4840-8c12-6374d741f7ca tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 200 len: 1304 microversion: 2.1 time: 0.096344 Jun 20 18:58:55.587346 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 569/1142] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:55 2022] GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:56.605814 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-91dacddb-860e-4e54-863f-785a74ad80b8 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:56.606500 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-91dacddb-860e-4e54-863f-785a74ad80b8 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: 08b2bc33-10f9-4930-9600-b2fc850360f6] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:56.612644 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91dacddb-860e-4e54-863f-785a74ad80b8 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:56.613089 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91dacddb-860e-4e54-863f-785a74ad80b8 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:56.614481 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91dacddb-860e-4e54-863f-785a74ad80b8 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:56.614908 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-91dacddb-860e-4e54-863f-785a74ad80b8 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:56.627687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-91dacddb-860e-4e54-863f-785a74ad80b8 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] HTTP exception thrown: Instance 08b2bc33-10f9-4930-9600-b2fc850360f6 could not be found. Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-91dacddb-860e-4e54-863f-785a74ad80b8 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Request method failure captured: Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 HTTP/1.1 Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMNgDLQ7QTd3L-MNPbbPy0jQYuoR1R8nIYOLWwm0YJIkgG52t5YVCAGL3dpYd4UWA50SqpCvP56foE2ZuJgpEaPtE05WEgxJejFx_z0VfESnFeAVuwDFUl8LiE5BoSF7lOnNSZ-XuRX6gJtRnz_hxRDevGdT_Jc_2Of77bpUS9h0nzc Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: b47706a33b164b94addea95a97469862 Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-VolumesActionsTest-1627536815 Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:58:56.629347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:58:56.631070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b47706a33b164b94addea95a97469862", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b47706a33b164b94addea95a97469862"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b47706a33b164b94addea95a97469862"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b47706a33b164b94addea95a97469862"}]}] Jun 20 18:58:56.631070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-VolumesActionsTest-1627536815 Jun 20 18:58:56.631070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: b47706a33b164b94addea95a97469862 Jun 20 18:58:56.631070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-VolumesActionsTest-1627536815 Jun 20 18:58:56.631070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-VolumesActionsTest-1627536815-project Jun 20 18:58:56.631070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:58:56.631070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:58:56.631070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: e00450cf0f954232bcabaac6c6d84b3c Jun 20 18:58:56.631070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-VolumesActionsTest-1627536815-project Jun 20 18:58:56.631070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:58:56.631070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance 08b2bc33-10f9-4930-9600-b2fc850360f6 could not be found. Jun 20 18:58:56.631070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '08b2bc33-10f9-4930-9600-b2fc850360f6'} Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08b2bc33-10f9-4930-9600-b2fc850360f6 could not be found. Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:58:56.632038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08b2bc33-10f9-4930-9600-b2fc850360f6 could not be found. Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08b2bc33-10f9-4930-9600-b2fc850360f6 could not be found. Jun 20 18:58:56.633659 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:58:56.635060 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-91dacddb-860e-4e54-863f-785a74ad80b8 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Returning 404 to user: Instance 08b2bc33-10f9-4930-9600-b2fc850360f6 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:58:56.635060 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-91dacddb-860e-4e54-863f-785a74ad80b8 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6" status: 404 len: 111 microversion: 2.1 time: 0.029655 Jun 20 18:58:56.635410 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 574/1143] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:56 2022] GET /compute/v2.1/servers/08b2bc33-10f9-4930-9600-b2fc850360f6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:58:56.678230 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1087525230", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452", "networks": [{"uuid": "70ed52e2-c895-4710-8f51-1d04f1233d8d"}]}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:58:56.727872 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.network.neutron [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] validate_networks() for [('70ed52e2-c895-4710-8f51-1d04f1233d8d', None, None, None, None, None)] {{(pid=124190) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:58:57.072425 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Flavor limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:58:57.072845 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Image limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:58:57.073315 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Flavor pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:58:57.073718 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Image pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:58:57.074122 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:58:57.082854 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:57.083327 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:57.084124 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:57.084558 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:57.100700 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Getting quotas for project b47706a33b164b94addea95a97469862. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:58:57.104615 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Getting quotas for user e00450cf0f954232bcabaac6c6d84b3c and project b47706a33b164b94addea95a97469862. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:58:57.115848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Going to run 1 instances... {{(pid=124190) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:58:57.118022 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124190) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:58:57.163053 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-94fb3e45-0fe3-4170-b9bf-f6f7a0dabc3c tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489195 Jun 20 18:58:57.163933 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 570/1144] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:58:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:58:57.173947 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6d0cbccd-aced-45a6-8562-08f96e788b03 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:57.174554 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6d0cbccd-aced-45a6-8562-08f96e788b03 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:57.230347 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6d0cbccd-aced-45a6-8562-08f96e788b03 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:57.237094 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6d0cbccd-aced-45a6-8562-08f96e788b03 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 200 len: 1214 microversion: 2.1 time: 0.066966 Jun 20 18:58:57.237652 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 575/1145] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:57 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:58.255036 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-53be9d11-9e4a-4743-8357-0288520e28ae tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:58.256285 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-53be9d11-9e4a-4743-8357-0288520e28ae tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:58.264043 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-53be9d11-9e4a-4743-8357-0288520e28ae tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:58.264853 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-53be9d11-9e4a-4743-8357-0288520e28ae tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:58.265341 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-53be9d11-9e4a-4743-8357-0288520e28ae tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:58.265782 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-53be9d11-9e4a-4743-8357-0288520e28ae tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:58.566642 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-53be9d11-9e4a-4743-8357-0288520e28ae tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:58.574943 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-53be9d11-9e4a-4743-8357-0288520e28ae tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 200 len: 1272 microversion: 2.1 time: 0.324357 Jun 20 18:58:58.575515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 571/1146] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:58 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:58:59.312745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-3abf0397-3a2f-4833-b309-3438b6809698 req-736d402f-5845-4049-8cac-8d970aa15ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ce8054-7d08-4fe5-810c-16b5af495c51", "tag": "fdf96199-b989-410a-a5cf-6cdfe35faca9"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:58:59.323314 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-3abf0397-3a2f-4833-b309-3438b6809698 req-736d402f-5845-4049-8cac-8d970aa15ea1 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:59.324067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-3abf0397-3a2f-4833-b309-3438b6809698 req-736d402f-5845-4049-8cac-8d970aa15ea1 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:59.335187 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-3abf0397-3a2f-4833-b309-3438b6809698 req-736d402f-5845-4049-8cac-8d970aa15ea1 service nova] Creating event network-changed:fdf96199-b989-410a-a5cf-6cdfe35faca9 for instance d8ce8054-7d08-4fe5-810c-16b5af495c51 on hv-cinder-83697 Jun 20 18:58:59.339821 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-3abf0397-3a2f-4833-b309-3438b6809698 req-736d402f-5845-4049-8cac-8d970aa15ea1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030906 Jun 20 18:58:59.340421 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 576/1147] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:58:59.592058 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-29c8b9b5-f9c2-48b9-9e4c-5ae971959a03 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:58:59.592588 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-29c8b9b5-f9c2-48b9-9e4c-5ae971959a03 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:58:59.600321 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-29c8b9b5-f9c2-48b9-9e4c-5ae971959a03 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:59.600796 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-29c8b9b5-f9c2-48b9-9e4c-5ae971959a03 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:59.601780 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-29c8b9b5-f9c2-48b9-9e4c-5ae971959a03 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:58:59.602438 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-29c8b9b5-f9c2-48b9-9e4c-5ae971959a03 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:58:59.733048 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-29c8b9b5-f9c2-48b9-9e4c-5ae971959a03 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:58:59.741059 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-29c8b9b5-f9c2-48b9-9e4c-5ae971959a03 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 200 len: 1314 microversion: 2.1 time: 0.152966 Jun 20 18:58:59.741610 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 572/1148] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:58:59 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:00.759164 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-22d4c442-be8f-43fd-a52d-9e32a167c1bf tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:00.759860 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-22d4c442-be8f-43fd-a52d-9e32a167c1bf tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:00.766032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-22d4c442-be8f-43fd-a52d-9e32a167c1bf tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:00.766474 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-22d4c442-be8f-43fd-a52d-9e32a167c1bf tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:00.767255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-22d4c442-be8f-43fd-a52d-9e32a167c1bf tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:00.767687 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-22d4c442-be8f-43fd-a52d-9e32a167c1bf tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:00.897073 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-22d4c442-be8f-43fd-a52d-9e32a167c1bf tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:00.904380 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-22d4c442-be8f-43fd-a52d-9e32a167c1bf tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 200 len: 1314 microversion: 2.1 time: 0.150604 Jun 20 18:59:00.904935 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 577/1149] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:00 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:01.921389 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-373200d7-d509-4549-865e-4fbd2abe3ab3 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:01.921989 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-373200d7-d509-4549-865e-4fbd2abe3ab3 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:01.928410 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-373200d7-d509-4549-865e-4fbd2abe3ab3 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:01.928851 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-373200d7-d509-4549-865e-4fbd2abe3ab3 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:01.929610 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-373200d7-d509-4549-865e-4fbd2abe3ab3 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:01.930038 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-373200d7-d509-4549-865e-4fbd2abe3ab3 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:02.059453 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-373200d7-d509-4549-865e-4fbd2abe3ab3 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:02.067389 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-373200d7-d509-4549-865e-4fbd2abe3ab3 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 200 len: 1314 microversion: 2.1 time: 0.149994 Jun 20 18:59:02.068617 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 573/1150] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:01 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:03.086098 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-18e56b46-3abb-4baa-a86b-37f7a9ae6919 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:03.086708 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-18e56b46-3abb-4baa-a86b-37f7a9ae6919 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:03.093445 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-18e56b46-3abb-4baa-a86b-37f7a9ae6919 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:03.093888 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-18e56b46-3abb-4baa-a86b-37f7a9ae6919 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:03.094642 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-18e56b46-3abb-4baa-a86b-37f7a9ae6919 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:03.095096 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-18e56b46-3abb-4baa-a86b-37f7a9ae6919 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:03.221900 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-18e56b46-3abb-4baa-a86b-37f7a9ae6919 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:03.229842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-18e56b46-3abb-4baa-a86b-37f7a9ae6919 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 200 len: 1314 microversion: 2.1 time: 0.148244 Jun 20 18:59:03.230402 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 578/1151] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:03 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:59:04.246065 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-247f2dcb-fe0e-40f2-9f5d-1f5f60adfbfa tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:04.246669 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-247f2dcb-fe0e-40f2-9f5d-1f5f60adfbfa tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:04.253175 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-247f2dcb-fe0e-40f2-9f5d-1f5f60adfbfa tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:04.253620 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-247f2dcb-fe0e-40f2-9f5d-1f5f60adfbfa tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:04.254368 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-247f2dcb-fe0e-40f2-9f5d-1f5f60adfbfa tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:04.254800 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-247f2dcb-fe0e-40f2-9f5d-1f5f60adfbfa tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:04.380833 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-247f2dcb-fe0e-40f2-9f5d-1f5f60adfbfa tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:04.388411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-247f2dcb-fe0e-40f2-9f5d-1f5f60adfbfa tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 200 len: 1314 microversion: 2.1 time: 0.146190 Jun 20 18:59:04.388964 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 574/1152] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:04 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:05.405265 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-90944248-8e8b-4cab-b698-936216d9b047 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:05.405792 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-90944248-8e8b-4cab-b698-936216d9b047 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:05.412873 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-90944248-8e8b-4cab-b698-936216d9b047 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:05.413311 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-90944248-8e8b-4cab-b698-936216d9b047 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:05.414057 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-90944248-8e8b-4cab-b698-936216d9b047 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:05.414482 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-90944248-8e8b-4cab-b698-936216d9b047 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:05.540814 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-90944248-8e8b-4cab-b698-936216d9b047 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:05.548320 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-90944248-8e8b-4cab-b698-936216d9b047 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 200 len: 1314 microversion: 2.1 time: 0.146970 Jun 20 18:59:05.548872 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 579/1153] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:05 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:06.123348 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-a960213d-c890-4e42-9abd-cd230e08d70c req-4274cc2b-b82a-4460-9e8b-1e9a87015956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ce8054-7d08-4fe5-810c-16b5af495c51", "name": "network-vif-plugged", "status": "completed", "tag": "fdf96199-b989-410a-a5cf-6cdfe35faca9"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:59:06.132954 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-a960213d-c890-4e42-9abd-cd230e08d70c req-4274cc2b-b82a-4460-9e8b-1e9a87015956 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:06.133417 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-a960213d-c890-4e42-9abd-cd230e08d70c req-4274cc2b-b82a-4460-9e8b-1e9a87015956 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:06.144908 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-a960213d-c890-4e42-9abd-cd230e08d70c req-4274cc2b-b82a-4460-9e8b-1e9a87015956 service nova] Creating event network-vif-plugged:fdf96199-b989-410a-a5cf-6cdfe35faca9 for instance d8ce8054-7d08-4fe5-810c-16b5af495c51 on hv-cinder-83697 Jun 20 18:59:06.149911 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-a960213d-c890-4e42-9abd-cd230e08d70c req-4274cc2b-b82a-4460-9e8b-1e9a87015956 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030251 Jun 20 18:59:06.150499 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 575/1154] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:59:06.565140 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5e0361e2-caa4-4ade-a4b6-3f9c066fca97 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:06.565748 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5e0361e2-caa4-4ade-a4b6-3f9c066fca97 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:06.572224 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5e0361e2-caa4-4ade-a4b6-3f9c066fca97 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:06.572672 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5e0361e2-caa4-4ade-a4b6-3f9c066fca97 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:06.573426 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5e0361e2-caa4-4ade-a4b6-3f9c066fca97 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:06.573859 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5e0361e2-caa4-4ade-a4b6-3f9c066fca97 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:06.699115 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5e0361e2-caa4-4ade-a4b6-3f9c066fca97 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:06.706437 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5e0361e2-caa4-4ade-a4b6-3f9c066fca97 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 200 len: 1314 microversion: 2.1 time: 0.145288 Jun 20 18:59:06.707008 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 580/1155] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:06 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:07.720320 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:07.721240 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=6 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:07.725712 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f80bd803-b667-4731-b090-64ccbae72a0a tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:07.726444 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f80bd803-b667-4731-b090-64ccbae72a0a tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:07.733482 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f80bd803-b667-4731-b090-64ccbae72a0a tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:07.733926 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f80bd803-b667-4731-b090-64ccbae72a0a tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:07.734681 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f80bd803-b667-4731-b090-64ccbae72a0a tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:07.735137 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f80bd803-b667-4731-b090-64ccbae72a0a tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:07.862848 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f80bd803-b667-4731-b090-64ccbae72a0a tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:07.870800 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f80bd803-b667-4731-b090-64ccbae72a0a tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 200 len: 1314 microversion: 2.1 time: 0.151504 Jun 20 18:59:07.871384 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 576/1156] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:07 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:08.887437 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8d590e81-0bc5-4950-bdad-fb34255592ea tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:08.888046 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8d590e81-0bc5-4950-bdad-fb34255592ea tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:08.889963 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:08.896581 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8d590e81-0bc5-4950-bdad-fb34255592ea tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:08.897026 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8d590e81-0bc5-4950-bdad-fb34255592ea tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:08.897776 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8d590e81-0bc5-4950-bdad-fb34255592ea tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:08.898210 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8d590e81-0bc5-4950-bdad-fb34255592ea tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:09.025827 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8d590e81-0bc5-4950-bdad-fb34255592ea tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:09.033442 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8d590e81-0bc5-4950-bdad-fb34255592ea tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 200 len: 1497 microversion: 2.1 time: 0.149836 Jun 20 18:59:09.034002 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 581/1157] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:08 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:09.465439 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-49466875-5c2e-4de3-a1fb-89c63e23a33f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:09.465948 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-49466875-5c2e-4de3-a1fb-89c63e23a33f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:09.472318 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-49466875-5c2e-4de3-a1fb-89c63e23a33f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:09.472756 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-49466875-5c2e-4de3-a1fb-89c63e23a33f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:09.473554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-49466875-5c2e-4de3-a1fb-89c63e23a33f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:09.474429 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-49466875-5c2e-4de3-a1fb-89c63e23a33f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:09.498797 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-49466875-5c2e-4de3-a1fb-89c63e23a33f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:59:09.523799 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:09.571876 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-49466875-5c2e-4de3-a1fb-89c63e23a33f tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 204 len: 0 microversion: 2.1 time: 0.110010 Jun 20 18:59:09.572673 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 577/1158] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:59:09 2022] DELETE /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 18:59:09.581338 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-e61925f2-5044-4a64-a698-73f9c475b92b tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:09.581943 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-e61925f2-5044-4a64-a698-73f9c475b92b tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:09.587916 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e61925f2-5044-4a64-a698-73f9c475b92b tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:09.588355 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e61925f2-5044-4a64-a698-73f9c475b92b tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:09.589198 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e61925f2-5044-4a64-a698-73f9c475b92b tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:09.589627 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-e61925f2-5044-4a64-a698-73f9c475b92b tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:09.718629 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-e61925f2-5044-4a64-a698-73f9c475b92b tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:09.726958 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-e61925f2-5044-4a64-a698-73f9c475b92b tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 200 len: 1503 microversion: 2.1 time: 0.149684 Jun 20 18:59:09.727455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 582/1159] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:09 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:10.745444 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b2e75378-ba7c-41d6-a23b-3368ce7f4655 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:10.746289 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b2e75378-ba7c-41d6-a23b-3368ce7f4655 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:10.752861 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b2e75378-ba7c-41d6-a23b-3368ce7f4655 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:10.753308 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b2e75378-ba7c-41d6-a23b-3368ce7f4655 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:10.754065 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b2e75378-ba7c-41d6-a23b-3368ce7f4655 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:10.754499 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b2e75378-ba7c-41d6-a23b-3368ce7f4655 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:10.884841 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-b2e75378-ba7c-41d6-a23b-3368ce7f4655 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:10.892489 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b2e75378-ba7c-41d6-a23b-3368ce7f4655 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 200 len: 1503 microversion: 2.1 time: 0.151215 Jun 20 18:59:10.893753 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 578/1160] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:10 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:11.619489 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-e7a2f110-487e-42c3-b6c1-8aaaf84edf84 req-52a93183-a63e-406a-b849-7c9809156b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ce8054-7d08-4fe5-810c-16b5af495c51", "name": "network-vif-deleted", "tag": "fdf96199-b989-410a-a5cf-6cdfe35faca9"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:59:11.623320 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:11.629059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-e7a2f110-487e-42c3-b6c1-8aaaf84edf84 req-52a93183-a63e-406a-b849-7c9809156b0a service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:11.629431 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-e7a2f110-487e-42c3-b6c1-8aaaf84edf84 req-52a93183-a63e-406a-b849-7c9809156b0a service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:11.632758 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=84 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:11.643217 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-e7a2f110-487e-42c3-b6c1-8aaaf84edf84 req-52a93183-a63e-406a-b849-7c9809156b0a service nova] Creating event network-vif-deleted:fdf96199-b989-410a-a5cf-6cdfe35faca9 for instance d8ce8054-7d08-4fe5-810c-16b5af495c51 on hv-cinder-83697 Jun 20 18:59:11.649082 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-e7a2f110-487e-42c3-b6c1-8aaaf84edf84 req-52a93183-a63e-406a-b849-7c9809156b0a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033150 Jun 20 18:59:11.649724 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 583/1161] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:59:11.909425 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-39f22231-2110-4173-a8fe-6c31637aba76 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:11.909975 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-39f22231-2110-4173-a8fe-6c31637aba76 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:11.916411 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-39f22231-2110-4173-a8fe-6c31637aba76 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:11.916852 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-39f22231-2110-4173-a8fe-6c31637aba76 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:11.917603 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-39f22231-2110-4173-a8fe-6c31637aba76 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:11.918031 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-39f22231-2110-4173-a8fe-6c31637aba76 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:11.948409 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-39f22231-2110-4173-a8fe-6c31637aba76 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:11.948850 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-39f22231-2110-4173-a8fe-6c31637aba76 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:11.949298 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-39f22231-2110-4173-a8fe-6c31637aba76 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lazy-loading 'fault' on Instance uuid d8ce8054-7d08-4fe5-810c-16b5af495c51 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:59:11.988225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-39f22231-2110-4173-a8fe-6c31637aba76 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00450cf0f954232bcabaac6c6d84b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47706a33b164b94addea95a97469862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:11.996098 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-39f22231-2110-4173-a8fe-6c31637aba76 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 200 len: 1304 microversion: 2.1 time: 0.090597 Jun 20 18:59:11.996660 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 579/1162] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:11 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:13.014688 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-749a56e1-ff0f-4353-bf7f-e91a3d381bd2 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:13.015409 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-749a56e1-ff0f-4353-bf7f-e91a3d381bd2 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] [instance: d8ce8054-7d08-4fe5-810c-16b5af495c51] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:13.022140 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-749a56e1-ff0f-4353-bf7f-e91a3d381bd2 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:13.022582 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-749a56e1-ff0f-4353-bf7f-e91a3d381bd2 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:13.023364 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-749a56e1-ff0f-4353-bf7f-e91a3d381bd2 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:13.023797 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-749a56e1-ff0f-4353-bf7f-e91a3d381bd2 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:13.037305 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-749a56e1-ff0f-4353-bf7f-e91a3d381bd2 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] HTTP exception thrown: Instance d8ce8054-7d08-4fe5-810c-16b5af495c51 could not be found. Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-749a56e1-ff0f-4353-bf7f-e91a3d381bd2 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Request method failure captured: Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 HTTP/1.1 Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMNgDLQ7QTd3L-MNPbbPy0jQYuoR1R8nIYOLWwm0YJIkgG52t5YVCAGL3dpYd4UWA50SqpCvP56foE2ZuJgpEaPtE05WEgxJejFx_z0VfESnFeAVuwDFUl8LiE5BoSF7lOnNSZ-XuRX6gJtRnz_hxRDevGdT_Jc_2Of77bpUS9h0nzc Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: b47706a33b164b94addea95a97469862 Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-VolumesActionsTest-1627536815 Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:59:13.038899 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:59:13.040559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b47706a33b164b94addea95a97469862", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b47706a33b164b94addea95a97469862"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b47706a33b164b94addea95a97469862"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b47706a33b164b94addea95a97469862"}]}] Jun 20 18:59:13.040559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-VolumesActionsTest-1627536815 Jun 20 18:59:13.040559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: b47706a33b164b94addea95a97469862 Jun 20 18:59:13.040559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-VolumesActionsTest-1627536815 Jun 20 18:59:13.040559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-VolumesActionsTest-1627536815-project Jun 20 18:59:13.040559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:59:13.040559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:59:13.040559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: e00450cf0f954232bcabaac6c6d84b3c Jun 20 18:59:13.040559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-VolumesActionsTest-1627536815-project Jun 20 18:59:13.040559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:59:13.040559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance d8ce8054-7d08-4fe5-810c-16b5af495c51 could not be found. Jun 20 18:59:13.040559 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': 'd8ce8054-7d08-4fe5-810c-16b5af495c51'} Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ce8054-7d08-4fe5-810c-16b5af495c51 could not be found. Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:59:13.041662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ce8054-7d08-4fe5-810c-16b5af495c51 could not be found. Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ce8054-7d08-4fe5-810c-16b5af495c51 could not be found. Jun 20 18:59:13.043242 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:59:13.044983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-749a56e1-ff0f-4353-bf7f-e91a3d381bd2 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] Returning 404 to user: Instance d8ce8054-7d08-4fe5-810c-16b5af495c51 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:59:13.044983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-749a56e1-ff0f-4353-bf7f-e91a3d381bd2 tempest-VolumesActionsTest-1627536815 tempest-VolumesActionsTest-1627536815-project] 10.222.0.43 "GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51" status: 404 len: 111 microversion: 2.1 time: 0.030244 Jun 20 18:59:13.044983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 584/1163] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:13 2022] GET /compute/v2.1/servers/d8ce8054-7d08-4fe5-810c-16b5af495c51 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 18:59:38.718863 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1673713984", "imageRef": "f4a0fce8-775a-4001-ac16-ffba839582af", "flavorRef": "452"}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:59:38.724724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:38.725379 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:38.772148 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.network.neutron [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] validate_networks() for None {{(pid=124190) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 18:59:39.039160 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Flavor limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 18:59:39.039580 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Image limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 18:59:39.040044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Flavor pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 18:59:39.040443 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Image pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 18:59:39.040843 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 18:59:39.050753 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:39.051237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:39.052022 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:39.052449 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:39.068480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Getting quotas for project 44115b735c764e248d69d478087654b9. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 18:59:39.072352 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Getting quotas for user 7bc871d13de9486099640b03158fe49f and project 44115b735c764e248d69d478087654b9. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 18:59:39.083026 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Going to run 1 instances... {{(pid=124190) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 18:59:39.085686 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4a0fce8-775a-4001-ac16-ffba839582af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124190) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 18:59:39.129775 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ec813962-5ca9-4d15-a03f-8e79cf236dcd tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.418458 Jun 20 18:59:39.130406 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 580/1164] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 18:59:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 18:59:39.140240 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-0b1bfc1b-5149-4637-8828-fbd6319b9dde tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:39.140849 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-0b1bfc1b-5149-4637-8828-fbd6319b9dde tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:39.143131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=3 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:39.143771 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=3 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:39.200222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-0b1bfc1b-5149-4637-8828-fbd6319b9dde tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc871d13de9486099640b03158fe49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44115b735c764e248d69d478087654b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:39.206939 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-0b1bfc1b-5149-4637-8828-fbd6319b9dde tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 200 len: 1215 microversion: 2.1 time: 0.070539 Jun 20 18:59:39.207597 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 585/1165] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:39 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:40.225532 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e3718caa-2b42-4973-bf2e-ba8db32d4df3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:40.227139 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e3718caa-2b42-4973-bf2e-ba8db32d4df3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:40.237038 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e3718caa-2b42-4973-bf2e-ba8db32d4df3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:40.237846 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e3718caa-2b42-4973-bf2e-ba8db32d4df3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:40.238837 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e3718caa-2b42-4973-bf2e-ba8db32d4df3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:40.239412 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e3718caa-2b42-4973-bf2e-ba8db32d4df3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:40.309693 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e3718caa-2b42-4973-bf2e-ba8db32d4df3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc871d13de9486099640b03158fe49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44115b735c764e248d69d478087654b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:40.317124 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e3718caa-2b42-4973-bf2e-ba8db32d4df3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 200 len: 1285 microversion: 2.1 time: 0.096164 Jun 20 18:59:40.317677 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 581/1166] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:40 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:41.333913 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-18be9627-f47d-42b8-8f72-56b0af6f5218 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:41.334514 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-18be9627-f47d-42b8-8f72-56b0af6f5218 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:41.342643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-18be9627-f47d-42b8-8f72-56b0af6f5218 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:41.343139 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-18be9627-f47d-42b8-8f72-56b0af6f5218 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:41.343897 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-18be9627-f47d-42b8-8f72-56b0af6f5218 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:41.344325 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-18be9627-f47d-42b8-8f72-56b0af6f5218 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:41.783656 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-18be9627-f47d-42b8-8f72-56b0af6f5218 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc871d13de9486099640b03158fe49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44115b735c764e248d69d478087654b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:41.791969 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-18be9627-f47d-42b8-8f72-56b0af6f5218 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 200 len: 1315 microversion: 2.1 time: 0.462269 Jun 20 18:59:41.792911 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 586/1167] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:41 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:41.983618 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-d6554324-3fa9-41c6-8711-a82b810cad1f req-7ee655d4-565b-4445-8353-2b0b5a9cdb9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07631dd-48f1-4252-bb32-c2e6c3d7b077", "tag": "d5603f97-123d-4455-9a0c-3ee45cfae3a4"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:59:41.995096 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-d6554324-3fa9-41c6-8711-a82b810cad1f req-7ee655d4-565b-4445-8353-2b0b5a9cdb9d service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:41.995738 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-d6554324-3fa9-41c6-8711-a82b810cad1f req-7ee655d4-565b-4445-8353-2b0b5a9cdb9d service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:42.008217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-d6554324-3fa9-41c6-8711-a82b810cad1f req-7ee655d4-565b-4445-8353-2b0b5a9cdb9d service nova] Creating event network-changed:d5603f97-123d-4455-9a0c-3ee45cfae3a4 for instance a07631dd-48f1-4252-bb32-c2e6c3d7b077 on hv-cinder-83697 Jun 20 18:59:42.013193 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-d6554324-3fa9-41c6-8711-a82b810cad1f req-7ee655d4-565b-4445-8353-2b0b5a9cdb9d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034889 Jun 20 18:59:42.014028 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 582/1168] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:59:42.810257 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4603a40f-2174-4c2d-97b4-f1db9c166444 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:42.810870 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-4603a40f-2174-4c2d-97b4-f1db9c166444 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:42.817344 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4603a40f-2174-4c2d-97b4-f1db9c166444 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:42.817784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4603a40f-2174-4c2d-97b4-f1db9c166444 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:42.818536 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4603a40f-2174-4c2d-97b4-f1db9c166444 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:42.819049 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4603a40f-2174-4c2d-97b4-f1db9c166444 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:42.949253 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-4603a40f-2174-4c2d-97b4-f1db9c166444 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc871d13de9486099640b03158fe49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44115b735c764e248d69d478087654b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:42.956662 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4603a40f-2174-4c2d-97b4-f1db9c166444 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 200 len: 1315 microversion: 2.1 time: 0.150572 Jun 20 18:59:42.957221 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 587/1169] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:42 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:43.974539 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2333ca8a-f08f-46c9-b4e1-6f240e0c360b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:43.975187 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2333ca8a-f08f-46c9-b4e1-6f240e0c360b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:43.981304 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2333ca8a-f08f-46c9-b4e1-6f240e0c360b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:43.981747 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2333ca8a-f08f-46c9-b4e1-6f240e0c360b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:43.982494 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2333ca8a-f08f-46c9-b4e1-6f240e0c360b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:43.982941 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2333ca8a-f08f-46c9-b4e1-6f240e0c360b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:44.107474 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2333ca8a-f08f-46c9-b4e1-6f240e0c360b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc871d13de9486099640b03158fe49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44115b735c764e248d69d478087654b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:44.114687 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2333ca8a-f08f-46c9-b4e1-6f240e0c360b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 200 len: 1315 microversion: 2.1 time: 0.144962 Jun 20 18:59:44.115270 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 583/1170] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:43 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:45.130605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-8b800e99-3a29-45bb-8196-c93fe9d0a56e tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:45.131239 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-8b800e99-3a29-45bb-8196-c93fe9d0a56e tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:45.138668 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8b800e99-3a29-45bb-8196-c93fe9d0a56e tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:45.139148 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8b800e99-3a29-45bb-8196-c93fe9d0a56e tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:45.139904 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8b800e99-3a29-45bb-8196-c93fe9d0a56e tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:45.140329 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-8b800e99-3a29-45bb-8196-c93fe9d0a56e tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:45.266140 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-8b800e99-3a29-45bb-8196-c93fe9d0a56e tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc871d13de9486099640b03158fe49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44115b735c764e248d69d478087654b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:45.273459 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-8b800e99-3a29-45bb-8196-c93fe9d0a56e tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 200 len: 1315 microversion: 2.1 time: 0.146705 Jun 20 18:59:45.274015 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 588/1171] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:45 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:46.289652 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4e73e790-b8b8-4edd-a77b-594c23986534 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:46.290290 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-4e73e790-b8b8-4edd-a77b-594c23986534 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:46.297136 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4e73e790-b8b8-4edd-a77b-594c23986534 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:46.297592 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4e73e790-b8b8-4edd-a77b-594c23986534 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:46.298352 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4e73e790-b8b8-4edd-a77b-594c23986534 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:46.298790 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4e73e790-b8b8-4edd-a77b-594c23986534 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:46.425023 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4e73e790-b8b8-4edd-a77b-594c23986534 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc871d13de9486099640b03158fe49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44115b735c764e248d69d478087654b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:46.432940 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4e73e790-b8b8-4edd-a77b-594c23986534 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 200 len: 1315 microversion: 2.1 time: 0.147316 Jun 20 18:59:46.433497 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 584/1172] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:46 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:47.449671 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-cd4800c8-521e-412d-b330-ebb51546afe5 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:47.450272 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-cd4800c8-521e-412d-b330-ebb51546afe5 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:47.456527 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cd4800c8-521e-412d-b330-ebb51546afe5 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:47.456974 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cd4800c8-521e-412d-b330-ebb51546afe5 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:47.457718 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cd4800c8-521e-412d-b330-ebb51546afe5 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:47.458147 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cd4800c8-521e-412d-b330-ebb51546afe5 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:47.582533 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-cd4800c8-521e-412d-b330-ebb51546afe5 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc871d13de9486099640b03158fe49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44115b735c764e248d69d478087654b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:47.590410 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-cd4800c8-521e-412d-b330-ebb51546afe5 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 200 len: 1315 microversion: 2.1 time: 0.144783 Jun 20 18:59:47.590982 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 589/1173] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:47 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:48.296644 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-2e3fb720-a969-47ff-870f-4bf0c15599b0 req-3881ce23-ada4-46b6-b054-5bce9e3afde8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07631dd-48f1-4252-bb32-c2e6c3d7b077", "name": "network-vif-plugged", "status": "completed", "tag": "d5603f97-123d-4455-9a0c-3ee45cfae3a4"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:59:48.305834 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-2e3fb720-a969-47ff-870f-4bf0c15599b0 req-3881ce23-ada4-46b6-b054-5bce9e3afde8 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:48.306424 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-2e3fb720-a969-47ff-870f-4bf0c15599b0 req-3881ce23-ada4-46b6-b054-5bce9e3afde8 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:48.317501 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-2e3fb720-a969-47ff-870f-4bf0c15599b0 req-3881ce23-ada4-46b6-b054-5bce9e3afde8 service nova] Creating event network-vif-plugged:d5603f97-123d-4455-9a0c-3ee45cfae3a4 for instance a07631dd-48f1-4252-bb32-c2e6c3d7b077 on hv-cinder-83697 Jun 20 18:59:48.322365 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-2e3fb720-a969-47ff-870f-4bf0c15599b0 req-3881ce23-ada4-46b6-b054-5bce9e3afde8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029656 Jun 20 18:59:48.323190 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 585/1174] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:59:48.607818 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d992639d-c985-4198-86fe-53145bf626cf tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:48.608429 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d992639d-c985-4198-86fe-53145bf626cf tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:48.614994 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d992639d-c985-4198-86fe-53145bf626cf tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:48.615444 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d992639d-c985-4198-86fe-53145bf626cf tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:48.616806 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d992639d-c985-4198-86fe-53145bf626cf tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:48.617252 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d992639d-c985-4198-86fe-53145bf626cf tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:48.745175 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d992639d-c985-4198-86fe-53145bf626cf tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc871d13de9486099640b03158fe49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44115b735c764e248d69d478087654b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:48.752510 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d992639d-c985-4198-86fe-53145bf626cf tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 200 len: 1315 microversion: 2.1 time: 0.148527 Jun 20 18:59:48.753070 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 590/1175] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:48 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:49.766638 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:49.767424 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=6 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:49.771875 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e0ba10f4-f3bb-490b-a213-99d37d54202b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:49.772598 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e0ba10f4-f3bb-490b-a213-99d37d54202b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:49.779597 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0ba10f4-f3bb-490b-a213-99d37d54202b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:49.780039 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0ba10f4-f3bb-490b-a213-99d37d54202b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:49.780797 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0ba10f4-f3bb-490b-a213-99d37d54202b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:49.781231 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e0ba10f4-f3bb-490b-a213-99d37d54202b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:49.909726 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e0ba10f4-f3bb-490b-a213-99d37d54202b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc871d13de9486099640b03158fe49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44115b735c764e248d69d478087654b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:49.917612 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e0ba10f4-f3bb-490b-a213-99d37d54202b tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 200 len: 1315 microversion: 2.1 time: 0.151886 Jun 20 18:59:49.918161 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 586/1176] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:49 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:50.934388 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-08ec7883-c824-469d-8d6a-47b3c099e1d3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:50.935016 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-08ec7883-c824-469d-8d6a-47b3c099e1d3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:50.936898 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:50.942707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-08ec7883-c824-469d-8d6a-47b3c099e1d3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:50.943174 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-08ec7883-c824-469d-8d6a-47b3c099e1d3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:50.943927 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-08ec7883-c824-469d-8d6a-47b3c099e1d3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:50.944401 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-08ec7883-c824-469d-8d6a-47b3c099e1d3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:51.071817 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-08ec7883-c824-469d-8d6a-47b3c099e1d3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc871d13de9486099640b03158fe49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44115b735c764e248d69d478087654b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:51.079156 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-08ec7883-c824-469d-8d6a-47b3c099e1d3 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 200 len: 1465 microversion: 2.1 time: 0.148628 Jun 20 18:59:51.079718 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 591/1177] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:50 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 1465 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:51.117414 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-48d789da-9427-40d6-bf9c-203f16cf9bad tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:51.117917 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-48d789da-9427-40d6-bf9c-203f16cf9bad tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:51.124351 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-48d789da-9427-40d6-bf9c-203f16cf9bad tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:51.125006 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-48d789da-9427-40d6-bf9c-203f16cf9bad tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:51.125764 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-48d789da-9427-40d6-bf9c-203f16cf9bad tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:51.126194 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-48d789da-9427-40d6-bf9c-203f16cf9bad tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:51.150483 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-48d789da-9427-40d6-bf9c-203f16cf9bad tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 18:59:51.225414 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-48d789da-9427-40d6-bf9c-203f16cf9bad tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 204 len: 0 microversion: 2.1 time: 0.111457 Jun 20 18:59:51.226708 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 587/1178] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 18:59:51 2022] DELETE /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 18:59:51.234722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-61f47e44-80d8-4dca-be28-c8a1b94cf7e1 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:51.235602 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-61f47e44-80d8-4dca-be28-c8a1b94cf7e1 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:51.241560 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-61f47e44-80d8-4dca-be28-c8a1b94cf7e1 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:51.242004 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-61f47e44-80d8-4dca-be28-c8a1b94cf7e1 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:51.242786 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-61f47e44-80d8-4dca-be28-c8a1b94cf7e1 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:51.243252 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-61f47e44-80d8-4dca-be28-c8a1b94cf7e1 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:51.369237 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-61f47e44-80d8-4dca-be28-c8a1b94cf7e1 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc871d13de9486099640b03158fe49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44115b735c764e248d69d478087654b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:51.376871 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-61f47e44-80d8-4dca-be28-c8a1b94cf7e1 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 200 len: 1471 microversion: 2.1 time: 0.146007 Jun 20 18:59:51.377423 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 592/1179] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:51 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 18:59:52.394942 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-62818659-a5f9-4c7f-959a-1efdfb8451ba tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:52.395647 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-62818659-a5f9-4c7f-959a-1efdfb8451ba tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:52.402334 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-62818659-a5f9-4c7f-959a-1efdfb8451ba tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:52.402782 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-62818659-a5f9-4c7f-959a-1efdfb8451ba tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:52.403569 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-62818659-a5f9-4c7f-959a-1efdfb8451ba tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:52.404005 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-62818659-a5f9-4c7f-959a-1efdfb8451ba tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:52.535541 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-62818659-a5f9-4c7f-959a-1efdfb8451ba tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc871d13de9486099640b03158fe49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44115b735c764e248d69d478087654b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:52.543275 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-62818659-a5f9-4c7f-959a-1efdfb8451ba tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 200 len: 1471 microversion: 2.1 time: 0.152554 Jun 20 18:59:52.544052 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 588/1180] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:52 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:53.227628 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-820dc5ea-5a32-4fd6-a588-856e89192b6b req-3de14d6a-ea96-4494-af02-7feeb0cc03a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07631dd-48f1-4252-bb32-c2e6c3d7b077", "name": "network-vif-deleted", "tag": "d5603f97-123d-4455-9a0c-3ee45cfae3a4"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 18:59:53.239354 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-820dc5ea-5a32-4fd6-a588-856e89192b6b req-3de14d6a-ea96-4494-af02-7feeb0cc03a1 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:53.239720 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-820dc5ea-5a32-4fd6-a588-856e89192b6b req-3de14d6a-ea96-4494-af02-7feeb0cc03a1 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:53.252605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-820dc5ea-5a32-4fd6-a588-856e89192b6b req-3de14d6a-ea96-4494-af02-7feeb0cc03a1 service nova] Creating event network-vif-deleted:d5603f97-123d-4455-9a0c-3ee45cfae3a4 for instance a07631dd-48f1-4252-bb32-c2e6c3d7b077 on hv-cinder-83697 Jun 20 18:59:53.257879 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-820dc5ea-5a32-4fd6-a588-856e89192b6b req-3de14d6a-ea96-4494-af02-7feeb0cc03a1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034786 Jun 20 18:59:53.258843 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 593/1181] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 18:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 18:59:53.560654 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-794ef4bf-9414-4824-a412-eae439f42ee6 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:53.561178 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-794ef4bf-9414-4824-a412-eae439f42ee6 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:53.567660 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-794ef4bf-9414-4824-a412-eae439f42ee6 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:53.568114 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-794ef4bf-9414-4824-a412-eae439f42ee6 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:53.568868 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-794ef4bf-9414-4824-a412-eae439f42ee6 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:53.569786 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-794ef4bf-9414-4824-a412-eae439f42ee6 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:53.599879 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-794ef4bf-9414-4824-a412-eae439f42ee6 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:53.600377 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-794ef4bf-9414-4824-a412-eae439f42ee6 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:53.600804 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-794ef4bf-9414-4824-a412-eae439f42ee6 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lazy-loading 'fault' on Instance uuid a07631dd-48f1-4252-bb32-c2e6c3d7b077 {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 18:59:53.640627 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-794ef4bf-9414-4824-a412-eae439f42ee6 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc871d13de9486099640b03158fe49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44115b735c764e248d69d478087654b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 18:59:53.648668 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-794ef4bf-9414-4824-a412-eae439f42ee6 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 200 len: 1305 microversion: 2.1 time: 0.092003 Jun 20 18:59:53.649217 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 589/1182] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:53 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 18:59:54.666531 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3f84c0cb-7ae0-47bd-98f4-c2fcc5306b06 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 18:59:54.667255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-3f84c0cb-7ae0-47bd-98f4-c2fcc5306b06 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] [instance: a07631dd-48f1-4252-bb32-c2e6c3d7b077] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 18:59:54.674460 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3f84c0cb-7ae0-47bd-98f4-c2fcc5306b06 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:54.674902 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3f84c0cb-7ae0-47bd-98f4-c2fcc5306b06 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:54.675676 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3f84c0cb-7ae0-47bd-98f4-c2fcc5306b06 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 18:59:54.676103 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3f84c0cb-7ae0-47bd-98f4-c2fcc5306b06 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 18:59:54.689758 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-3f84c0cb-7ae0-47bd-98f4-c2fcc5306b06 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] HTTP exception thrown: Instance a07631dd-48f1-4252-bb32-c2e6c3d7b077 could not be found. Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3f84c0cb-7ae0-47bd-98f4-c2fcc5306b06 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Request method failure captured: Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 HTTP/1.1 Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMOZkxfb2VepOTTmWqu8WQ_1l2gqqtm7eT_mTUUB9x90vXiYCxPQgEQr38N6NJmE-bgu5ZkJvzPpHRpjSxOuqJd1mSopgyttBltS29jRw37cGKZofc72WNP_X_ge5FPxZPxD0-9C3U6G7KgVfRW6f680QHA2_jEIErthr-I4bFzGOT0 Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: 44115b735c764e248d69d478087654b9 Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-VolumesNegativeTest-261567377 Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 18:59:54.691383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 18:59:54.693092 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_44115b735c764e248d69d478087654b9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/44115b735c764e248d69d478087654b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44115b735c764e248d69d478087654b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44115b735c764e248d69d478087654b9"}]}] Jun 20 18:59:54.693092 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-VolumesNegativeTest-261567377 Jun 20 18:59:54.693092 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: 44115b735c764e248d69d478087654b9 Jun 20 18:59:54.693092 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-VolumesNegativeTest-261567377 Jun 20 18:59:54.693092 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-VolumesNegativeTest-261567377-project Jun 20 18:59:54.693092 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 18:59:54.693092 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 18:59:54.693092 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 7bc871d13de9486099640b03158fe49f Jun 20 18:59:54.693092 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-VolumesNegativeTest-261567377-project Jun 20 18:59:54.693092 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 18:59:54.693092 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance a07631dd-48f1-4252-bb32-c2e6c3d7b077 could not be found. Jun 20 18:59:54.693092 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': 'a07631dd-48f1-4252-bb32-c2e6c3d7b077'} Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a07631dd-48f1-4252-bb32-c2e6c3d7b077 could not be found. Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 18:59:54.694043 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a07631dd-48f1-4252-bb32-c2e6c3d7b077 could not be found. Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a07631dd-48f1-4252-bb32-c2e6c3d7b077 could not be found. Jun 20 18:59:54.696255 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 18:59:54.698158 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3f84c0cb-7ae0-47bd-98f4-c2fcc5306b06 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] Returning 404 to user: Instance a07631dd-48f1-4252-bb32-c2e6c3d7b077 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 18:59:54.698158 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-3f84c0cb-7ae0-47bd-98f4-c2fcc5306b06 tempest-VolumesNegativeTest-261567377 tempest-VolumesNegativeTest-261567377-project] 10.222.0.43 "GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077" status: 404 len: 111 microversion: 2.1 time: 0.030834 Jun 20 18:59:54.698158 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 594/1183] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 18:59:54 2022] GET /compute/v2.1/servers/a07631dd-48f1-4252-bb32-c2e6c3d7b077 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 19:00:01.471409 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:00:01.471959 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Mon Jun 20 19:00:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:00:08.168011 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:08.168011 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:08.394514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2e2d139a-3991-4dfe-972e-ce1e7e79f2cb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Action: 'create', calling method: .version_select at 0x7f7e44d89700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-339444055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPRg0EfMN/qZfz7IqVU1fw2y/cXUxc7IuK7Lr+TnGtm/TwEdc8xv9TCQs+PMIU+1VI5tc0iZ4RxLeWy3tB1BCOhWnWM6Z32TGK2dy6dLTjrZPDi3htYJCEifQq26++3gA=="}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:00:08.409851 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-2e2d139a-3991-4dfe-972e-ce1e7e79f2cb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Getting quotas for project b68045cdaa7343e0a991a76987416ded. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 19:00:08.414560 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-2e2d139a-3991-4dfe-972e-ce1e7e79f2cb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Getting quotas for user 70f12d37abe544eb8fa356b0f0341c08 and project b68045cdaa7343e0a991a76987416ded. Resources: {'key_pairs'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 19:00:08.437881 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2e2d139a-3991-4dfe-972e-ce1e7e79f2cb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.276893 Jun 20 19:00:08.438484 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 590/1184] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jun 20 19:00:08 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 19:00:28.923493 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1014587139", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-339444055", "security_groups": [{"name": "tempest-secgroup-smoke-997610182"}], "block_device_mapping_v2": [{"uuid": "6b1fc677-6828-433f-bca9-4d7f3c00c240", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7f2c5ab-61b6-4dcc-9f9d-3b9d75a153bb"}]}} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:00:28.932569 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=22 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:28.933218 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=46 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:29.034533 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.network.neutron [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] validate_networks() for [('e7f2c5ab-61b6-4dcc-9f9d-3b9d75a153bb', None, None, None, None, None)] {{(pid=124189) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 19:00:29.386705 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Flavor limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 19:00:29.387159 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Image limits 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 19:00:29.387629 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Flavor pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 19:00:29.388031 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Image pref 0:0:0 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 19:00:29.388432 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.virt.hardware [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 19:00:29.397798 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:29.398243 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:29.399074 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:29.399505 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:29.416234 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Getting quotas for project b68045cdaa7343e0a991a76987416ded. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 19:00:29.420150 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.quota [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Getting quotas for user 70f12d37abe544eb8fa356b0f0341c08 and project b68045cdaa7343e0a991a76987416ded. Resources: {'cores', 'ram', 'instances'} {{(pid=124189) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 19:00:29.475327 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Going to run 1 instances... {{(pid=124189) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 19:00:29.477999 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b1fc677-6828-433f-bca9-4d7f3c00c240',volume_size=None,volume_type=None)] {{(pid=124189) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 19:00:29.600876 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-3f8d7919-7f3b-4995-ae6f-07d0ddc2892b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.681445 Jun 20 19:00:29.601498 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 595/1185] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 19:00:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 19:00:29.609179 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=4 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:29.609922 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:29.614306 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-79ec9682-99a6-42b1-99d5-2c62dc0b0a75 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:29.614940 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-79ec9682-99a6-42b1-99d5-2c62dc0b0a75 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:29.673371 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-79ec9682-99a6-42b1-99d5-2c62dc0b0a75 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:29.681115 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-79ec9682-99a6-42b1-99d5-2c62dc0b0a75 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1094 microversion: 2.1 time: 0.073073 Jun 20 19:00:29.681674 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 591/1186] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:29 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:00:30.701663 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-210f4986-d7f5-46cf-a550-b7b0a39a0630 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:30.702901 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-210f4986-d7f5-46cf-a550-b7b0a39a0630 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:30.711119 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-210f4986-d7f5-46cf-a550-b7b0a39a0630 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:30.711571 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-210f4986-d7f5-46cf-a550-b7b0a39a0630 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:30.712565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-210f4986-d7f5-46cf-a550-b7b0a39a0630 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:30.713180 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-210f4986-d7f5-46cf-a550-b7b0a39a0630 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:30.783778 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-210f4986-d7f5-46cf-a550-b7b0a39a0630 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:30.791143 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-210f4986-d7f5-46cf-a550-b7b0a39a0630 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1210 microversion: 2.1 time: 0.094894 Jun 20 19:00:30.793598 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 596/1187] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:30 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 19:00:31.810710 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e5d6ba7c-6ed1-46c3-a24b-04904f7a8944 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:31.811335 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e5d6ba7c-6ed1-46c3-a24b-04904f7a8944 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:31.817793 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e5d6ba7c-6ed1-46c3-a24b-04904f7a8944 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:31.818246 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e5d6ba7c-6ed1-46c3-a24b-04904f7a8944 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:31.819111 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e5d6ba7c-6ed1-46c3-a24b-04904f7a8944 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:31.819528 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e5d6ba7c-6ed1-46c3-a24b-04904f7a8944 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:31.958442 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e5d6ba7c-6ed1-46c3-a24b-04904f7a8944 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:31.966734 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e5d6ba7c-6ed1-46c3-a24b-04904f7a8944 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1265 microversion: 2.1 time: 0.161115 Jun 20 19:00:31.967448 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 592/1188] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:31 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:00:32.137492 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-c637c705-fc64-417d-8b97-bde3467a1b06 req-73427d30-85c7-4119-9e01-a9993fe15f4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2218f1dc-73dd-45f8-bccf-844445a0cee1", "tag": "82353bbf-48ee-4be6-8473-5172b344fead"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:00:32.151325 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-c637c705-fc64-417d-8b97-bde3467a1b06 req-73427d30-85c7-4119-9e01-a9993fe15f4b service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:32.151875 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-c637c705-fc64-417d-8b97-bde3467a1b06 req-73427d30-85c7-4119-9e01-a9993fe15f4b service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:32.164528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-c637c705-fc64-417d-8b97-bde3467a1b06 req-73427d30-85c7-4119-9e01-a9993fe15f4b service nova] Creating event network-changed:82353bbf-48ee-4be6-8473-5172b344fead for instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 on hv-cinder-83697 Jun 20 19:00:32.169742 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-c637c705-fc64-417d-8b97-bde3467a1b06 req-73427d30-85c7-4119-9e01-a9993fe15f4b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037860 Jun 20 19:00:32.170898 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 597/1189] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 19:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 19:00:32.984259 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-25d532cc-02b6-4513-acaf-f034fe22ca50 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:32.984865 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-25d532cc-02b6-4513-acaf-f034fe22ca50 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:32.991865 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-25d532cc-02b6-4513-acaf-f034fe22ca50 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:32.992310 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-25d532cc-02b6-4513-acaf-f034fe22ca50 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:32.993061 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-25d532cc-02b6-4513-acaf-f034fe22ca50 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:32.993491 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-25d532cc-02b6-4513-acaf-f034fe22ca50 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:33.125628 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-25d532cc-02b6-4513-acaf-f034fe22ca50 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:33.133685 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-25d532cc-02b6-4513-acaf-f034fe22ca50 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1265 microversion: 2.1 time: 0.153296 Jun 20 19:00:33.134237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 593/1190] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:32 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:00:34.150772 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5572efc8-8889-47eb-9211-7a62df019dad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:34.151497 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5572efc8-8889-47eb-9211-7a62df019dad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:34.157699 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5572efc8-8889-47eb-9211-7a62df019dad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:34.158140 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5572efc8-8889-47eb-9211-7a62df019dad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:34.158893 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5572efc8-8889-47eb-9211-7a62df019dad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:34.159342 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5572efc8-8889-47eb-9211-7a62df019dad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:34.296310 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5572efc8-8889-47eb-9211-7a62df019dad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:34.304732 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5572efc8-8889-47eb-9211-7a62df019dad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1265 microversion: 2.1 time: 0.158673 Jun 20 19:00:34.305281 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 598/1191] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:34 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:00:35.321643 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-505b003c-403f-4cac-9912-ac8a6a8b0cad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:35.322259 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-505b003c-403f-4cac-9912-ac8a6a8b0cad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:35.328706 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-505b003c-403f-4cac-9912-ac8a6a8b0cad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:35.329151 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-505b003c-403f-4cac-9912-ac8a6a8b0cad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:35.329899 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-505b003c-403f-4cac-9912-ac8a6a8b0cad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:35.330328 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-505b003c-403f-4cac-9912-ac8a6a8b0cad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:35.455997 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-505b003c-403f-4cac-9912-ac8a6a8b0cad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:35.463853 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-505b003c-403f-4cac-9912-ac8a6a8b0cad tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1265 microversion: 2.1 time: 0.146289 Jun 20 19:00:35.464405 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 594/1192] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:35 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:00:36.480584 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-93487e86-8122-4437-ae23-b2bac67b331d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:36.481188 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-93487e86-8122-4437-ae23-b2bac67b331d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:36.487595 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-93487e86-8122-4437-ae23-b2bac67b331d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:36.488034 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-93487e86-8122-4437-ae23-b2bac67b331d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:36.488780 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-93487e86-8122-4437-ae23-b2bac67b331d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:36.489216 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-93487e86-8122-4437-ae23-b2bac67b331d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:36.619183 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-93487e86-8122-4437-ae23-b2bac67b331d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:36.626500 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-93487e86-8122-4437-ae23-b2bac67b331d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1265 microversion: 2.1 time: 0.149797 Jun 20 19:00:36.627081 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 599/1193] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:36 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:00:37.643718 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8dbcbbb0-ee62-4954-9f28-d6ec4f0f8192 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:37.644262 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8dbcbbb0-ee62-4954-9f28-d6ec4f0f8192 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:37.651246 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8dbcbbb0-ee62-4954-9f28-d6ec4f0f8192 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:37.651694 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8dbcbbb0-ee62-4954-9f28-d6ec4f0f8192 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:37.652448 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8dbcbbb0-ee62-4954-9f28-d6ec4f0f8192 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:37.652883 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8dbcbbb0-ee62-4954-9f28-d6ec4f0f8192 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:37.785757 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8dbcbbb0-ee62-4954-9f28-d6ec4f0f8192 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:37.793338 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8dbcbbb0-ee62-4954-9f28-d6ec4f0f8192 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1265 microversion: 2.1 time: 0.153522 Jun 20 19:00:37.793934 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 595/1194] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:37 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:00:38.810333 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d1cc580e-2511-48aa-a33c-37f481b860eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:38.810951 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d1cc580e-2511-48aa-a33c-37f481b860eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:38.817376 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d1cc580e-2511-48aa-a33c-37f481b860eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:38.817821 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d1cc580e-2511-48aa-a33c-37f481b860eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:38.818575 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d1cc580e-2511-48aa-a33c-37f481b860eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:38.819621 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d1cc580e-2511-48aa-a33c-37f481b860eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:38.946944 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d1cc580e-2511-48aa-a33c-37f481b860eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:38.954288 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d1cc580e-2511-48aa-a33c-37f481b860eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1265 microversion: 2.1 time: 0.147803 Jun 20 19:00:38.954836 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 600/1195] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:38 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:00:39.971142 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7740cf51-f713-4491-90d6-16b62b148347 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:39.971691 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7740cf51-f713-4491-90d6-16b62b148347 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:39.974057 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:39.979410 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7740cf51-f713-4491-90d6-16b62b148347 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:39.979856 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7740cf51-f713-4491-90d6-16b62b148347 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:39.980612 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7740cf51-f713-4491-90d6-16b62b148347 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:39.981047 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7740cf51-f713-4491-90d6-16b62b148347 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:40.108691 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7740cf51-f713-4491-90d6-16b62b148347 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:40.116719 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7740cf51-f713-4491-90d6-16b62b148347 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1265 microversion: 2.1 time: 0.148986 Jun 20 19:00:40.117276 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 596/1196] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:39 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:00:41.134294 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-cb312806-659d-4912-971d-60b8d813f401 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:41.135129 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-cb312806-659d-4912-971d-60b8d813f401 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:41.138458 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:41.139133 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=6 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:41.143289 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cb312806-659d-4912-971d-60b8d813f401 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:41.143788 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cb312806-659d-4912-971d-60b8d813f401 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:41.144695 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cb312806-659d-4912-971d-60b8d813f401 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:41.145058 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-cb312806-659d-4912-971d-60b8d813f401 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:41.280109 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-cb312806-659d-4912-971d-60b8d813f401 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:41.287420 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-cb312806-659d-4912-971d-60b8d813f401 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1265 microversion: 2.1 time: 0.157697 Jun 20 19:00:41.288610 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 601/1197] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:41 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 19:00:42.305119 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-34c6a600-02ed-40ee-b09e-36233ddc9c4a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:42.305735 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-34c6a600-02ed-40ee-b09e-36233ddc9c4a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:42.312254 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-34c6a600-02ed-40ee-b09e-36233ddc9c4a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:42.312705 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-34c6a600-02ed-40ee-b09e-36233ddc9c4a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:42.313467 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-34c6a600-02ed-40ee-b09e-36233ddc9c4a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:42.313905 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-34c6a600-02ed-40ee-b09e-36233ddc9c4a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:42.445713 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-34c6a600-02ed-40ee-b09e-36233ddc9c4a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:42.453274 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-34c6a600-02ed-40ee-b09e-36233ddc9c4a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1265 microversion: 2.1 time: 0.152044 Jun 20 19:00:42.454034 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 597/1198] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:42 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:00:42.613947 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-299e69a3-bf7d-49e0-b8c6-42df16965a05 req-be853c34-7f76-4606-90c8-100d34529c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2218f1dc-73dd-45f8-bccf-844445a0cee1", "name": "network-vif-plugged", "status": "completed", "tag": "82353bbf-48ee-4be6-8473-5172b344fead"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:00:42.624428 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-299e69a3-bf7d-49e0-b8c6-42df16965a05 req-be853c34-7f76-4606-90c8-100d34529c11 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:42.624878 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-299e69a3-bf7d-49e0-b8c6-42df16965a05 req-be853c34-7f76-4606-90c8-100d34529c11 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:42.638701 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-299e69a3-bf7d-49e0-b8c6-42df16965a05 req-be853c34-7f76-4606-90c8-100d34529c11 service nova] Creating event network-vif-plugged:82353bbf-48ee-4be6-8473-5172b344fead for instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 on hv-cinder-83697 Jun 20 19:00:42.643789 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-299e69a3-bf7d-49e0-b8c6-42df16965a05 req-be853c34-7f76-4606-90c8-100d34529c11 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033560 Jun 20 19:00:42.644370 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 602/1199] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 19:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 19:00:43.470728 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-4d297dac-b177-4f57-9768-d273106317dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:43.471382 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-4d297dac-b177-4f57-9768-d273106317dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:43.478566 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4d297dac-b177-4f57-9768-d273106317dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:43.479050 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4d297dac-b177-4f57-9768-d273106317dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:43.479805 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4d297dac-b177-4f57-9768-d273106317dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:43.480236 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-4d297dac-b177-4f57-9768-d273106317dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:43.606818 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-4d297dac-b177-4f57-9768-d273106317dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:43.614344 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-4d297dac-b177-4f57-9768-d273106317dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1265 microversion: 2.1 time: 0.147461 Jun 20 19:00:43.614898 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 598/1200] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:43 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:00:44.631432 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-60a41fef-b16f-419c-aa44-e6ddf381401e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:44.632543 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-60a41fef-b16f-419c-aa44-e6ddf381401e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:44.639155 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-60a41fef-b16f-419c-aa44-e6ddf381401e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:44.639602 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-60a41fef-b16f-419c-aa44-e6ddf381401e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:44.640344 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-60a41fef-b16f-419c-aa44-e6ddf381401e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:44.640768 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-60a41fef-b16f-419c-aa44-e6ddf381401e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:44.771422 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-60a41fef-b16f-419c-aa44-e6ddf381401e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:44.779056 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-60a41fef-b16f-419c-aa44-e6ddf381401e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1453 microversion: 2.1 time: 0.151904 Jun 20 19:00:44.779611 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 603/1201] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:44 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:00:44.795704 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-16f3735d-5034-4a24-8a54-d2aa660368df tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:00:44.796312 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-16f3735d-5034-4a24-8a54-d2aa660368df tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:00:44.802940 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-16f3735d-5034-4a24-8a54-d2aa660368df tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:44.803397 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-16f3735d-5034-4a24-8a54-d2aa660368df tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:44.804698 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-16f3735d-5034-4a24-8a54-d2aa660368df tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:44.805132 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-16f3735d-5034-4a24-8a54-d2aa660368df tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:44.932268 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-16f3735d-5034-4a24-8a54-d2aa660368df tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:00:44.939801 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-16f3735d-5034-4a24-8a54-d2aa660368df tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1453 microversion: 2.1 time: 0.147899 Jun 20 19:00:44.940359 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 599/1202] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:00:44 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:00:46.892581 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-51a11d66-a030-4466-9829-bc0d98839c12 req-279a7aff-858e-47b4-9921-80e9cfe25551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2218f1dc-73dd-45f8-bccf-844445a0cee1", "tag": "82353bbf-48ee-4be6-8473-5172b344fead"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:00:46.901103 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-51a11d66-a030-4466-9829-bc0d98839c12 req-279a7aff-858e-47b4-9921-80e9cfe25551 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:00:46.901544 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-51a11d66-a030-4466-9829-bc0d98839c12 req-279a7aff-858e-47b4-9921-80e9cfe25551 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:00:46.912132 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-51a11d66-a030-4466-9829-bc0d98839c12 req-279a7aff-858e-47b4-9921-80e9cfe25551 service nova] Creating event network-changed:82353bbf-48ee-4be6-8473-5172b344fead for instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 on hv-cinder-83697 Jun 20 19:00:46.917232 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-51a11d66-a030-4466-9829-bc0d98839c12 req-279a7aff-858e-47b4-9921-80e9cfe25551 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116609 Jun 20 19:00:46.917811 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 604/1203] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 19:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 19:02:51.718021 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:02:51.718547 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Mon Jun 20 19:02:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:03:00.581179 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e3254d7a-d342-4c78-8a24-17a4c1dcb7a5] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 20 19:03:00.581840 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=20 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:03:00.582475 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=48 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:03:00.586268 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-53a48c19-6737-4083-bcb1-d13406076c2a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:00.586759 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-53a48c19-6737-4083-bcb1-d13406076c2a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:00.593482 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-53a48c19-6737-4083-bcb1-d13406076c2a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:00.593928 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-53a48c19-6737-4083-bcb1-d13406076c2a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:00.594688 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-53a48c19-6737-4083-bcb1-d13406076c2a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:00.595150 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-53a48c19-6737-4083-bcb1-d13406076c2a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:00.620200 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-53a48c19-6737-4083-bcb1-d13406076c2a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 19:03:00.691910 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-53a48c19-6737-4083-bcb1-d13406076c2a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 204 len: 0 microversion: 2.1 time: 0.112544 Jun 20 19:03:00.692484 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 600/1204] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 19:03:00 2022] DELETE /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 19:03:00.699014 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3beabe7-1367-488a-a1bc-9e490e45a7fa] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 19:03:00.699635 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:03:00.700499 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=44 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:03:00.704821 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ecfdc7b6-c37b-4f41-b2d3-472c374f1647 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:00.705550 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ecfdc7b6-c37b-4f41-b2d3-472c374f1647 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:00.713283 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ecfdc7b6-c37b-4f41-b2d3-472c374f1647 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:00.713728 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ecfdc7b6-c37b-4f41-b2d3-472c374f1647 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:00.714490 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ecfdc7b6-c37b-4f41-b2d3-472c374f1647 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:00.714945 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ecfdc7b6-c37b-4f41-b2d3-472c374f1647 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:00.894126 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ecfdc7b6-c37b-4f41-b2d3-472c374f1647 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:00.901571 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ecfdc7b6-c37b-4f41-b2d3-472c374f1647 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1578 microversion: 2.1 time: 0.204506 Jun 20 19:03:00.902132 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 605/1205] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:00 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1578 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:01.530341 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:03:01.530561 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Mon Jun 20 19:03:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:03:01.919233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-860d6f7d-0587-4f4d-bbbb-43717d17dc0d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:01.919930 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-860d6f7d-0587-4f4d-bbbb-43717d17dc0d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:01.928027 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-860d6f7d-0587-4f4d-bbbb-43717d17dc0d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:01.928472 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-860d6f7d-0587-4f4d-bbbb-43717d17dc0d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:01.929233 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-860d6f7d-0587-4f4d-bbbb-43717d17dc0d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:01.929672 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-860d6f7d-0587-4f4d-bbbb-43717d17dc0d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:01.937996 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO oslo.messaging._drivers.impl_rabbit [-] [e3254d7a-d342-4c78-8a24-17a4c1dcb7a5] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 59644. Jun 20 19:03:02.118633 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-860d6f7d-0587-4f4d-bbbb-43717d17dc0d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:02.126229 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-860d6f7d-0587-4f4d-bbbb-43717d17dc0d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1578 microversion: 2.1 time: 0.211306 Jun 20 19:03:02.126778 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 601/1206] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:01 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:03.145722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4bf0f7c0-825a-42ea-ab54-b9a694a7def3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:03.146862 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-4bf0f7c0-825a-42ea-ab54-b9a694a7def3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:03.158357 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3beabe7-1367-488a-a1bc-9e490e45a7fa] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 59652. Jun 20 19:03:03.162891 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4bf0f7c0-825a-42ea-ab54-b9a694a7def3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:03.163543 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4bf0f7c0-825a-42ea-ab54-b9a694a7def3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:03.164312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4bf0f7c0-825a-42ea-ab54-b9a694a7def3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:03.164745 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4bf0f7c0-825a-42ea-ab54-b9a694a7def3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:03.260458 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-4bf0f7c0-825a-42ea-ab54-b9a694a7def3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:03.267836 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4bf0f7c0-825a-42ea-ab54-b9a694a7def3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 200 len: 1511 microversion: 2.1 time: 0.127176 Jun 20 19:03:03.268590 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 606/1207] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:03 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 1511 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:03.471735 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-37eca79b-0745-4412-8019-23cd85c8821b req-d69ce499-ce4c-4a12-8e25-2ab668f4c2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2218f1dc-73dd-45f8-bccf-844445a0cee1", "name": "network-vif-deleted", "tag": "82353bbf-48ee-4be6-8473-5172b344fead"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:03:03.483302 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-37eca79b-0745-4412-8019-23cd85c8821b req-d69ce499-ce4c-4a12-8e25-2ab668f4c2be service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:03.483775 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-37eca79b-0745-4412-8019-23cd85c8821b req-d69ce499-ce4c-4a12-8e25-2ab668f4c2be service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:03.496923 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-37eca79b-0745-4412-8019-23cd85c8821b req-d69ce499-ce4c-4a12-8e25-2ab668f4c2be service nova] Creating event network-vif-deleted:82353bbf-48ee-4be6-8473-5172b344fead for instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 on hv-cinder-83697 Jun 20 19:03:03.509525 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-37eca79b-0745-4412-8019-23cd85c8821b req-d69ce499-ce4c-4a12-8e25-2ab668f4c2be service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041752 Jun 20 19:03:03.510280 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 602/1208] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 19:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 19:03:04.285798 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5ed4b14f-f79e-427d-897c-446967c4bc32 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:04.286947 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5ed4b14f-f79e-427d-897c-446967c4bc32 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:04.293583 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5ed4b14f-f79e-427d-897c-446967c4bc32 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:04.294032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5ed4b14f-f79e-427d-897c-446967c4bc32 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:04.294826 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5ed4b14f-f79e-427d-897c-446967c4bc32 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:04.295315 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-5ed4b14f-f79e-427d-897c-446967c4bc32 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:04.309983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-5ed4b14f-f79e-427d-897c-446967c4bc32 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] HTTP exception thrown: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5ed4b14f-f79e-427d-897c-446967c4bc32 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Request method failure captured: Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 HTTP/1.1 Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMOzmMUSeumSLDS80wR3hK9mAWokj-FNYnsoMD6Vqy5EGaX_OlKNbeCMgQCL65-B9IXSHsTlExgBj-OpSqLtV4IU4h9c45CjpDPVQLAoECXqYW99ndlsvpF3fqXp6d9Lapj4JNhrPMKMnw-P8gaIQzJ0nIAJuXEQNRfkMrjMkxVwDeI Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: b68045cdaa7343e0a991a76987416ded Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 19:03:04.311722 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 19:03:04.313654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b68045cdaa7343e0a991a76987416ded", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b68045cdaa7343e0a991a76987416ded"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b68045cdaa7343e0a991a76987416ded"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b68045cdaa7343e0a991a76987416ded"}]}] Jun 20 19:03:04.313654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:03:04.313654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: b68045cdaa7343e0a991a76987416ded Jun 20 19:03:04.313654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:03:04.313654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-TestVolumeBootPattern-1070629529-project Jun 20 19:03:04.313654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 19:03:04.313654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 19:03:04.313654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 70f12d37abe544eb8fa356b0f0341c08 Jun 20 19:03:04.313654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-TestVolumeBootPattern-1070629529-project Jun 20 19:03:04.313654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 19:03:04.313654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:03:04.313654 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '2218f1dc-73dd-45f8-bccf-844445a0cee1'} Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 19:03:04.314784 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:03:04.316501 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:03:04.317983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5ed4b14f-f79e-427d-897c-446967c4bc32 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Returning 404 to user: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 19:03:04.317983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5ed4b14f-f79e-427d-897c-446967c4bc32 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 404 len: 111 microversion: 2.1 time: 0.031368 Jun 20 19:03:04.321351 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 607/1209] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:04 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 19:03:04.360021 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1885140523", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-339444055", "security_groups": [{"name": "tempest-secgroup-smoke-997610182"}], "block_device_mapping_v2": [{"uuid": "6b1fc677-6828-433f-bca9-4d7f3c00c240", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7f2c5ab-61b6-4dcc-9f9d-3b9d75a153bb"}]}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:03:04.473627 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.network.neutron [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] validate_networks() for [('e7f2c5ab-61b6-4dcc-9f9d-3b9d75a153bb', None, None, None, None, None)] {{(pid=124190) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 19:03:04.872331 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Flavor limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 19:03:04.872751 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Image limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 19:03:04.873221 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Flavor pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 19:03:04.873622 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Image pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 19:03:04.874029 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 19:03:04.882665 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:04.883155 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:04.883947 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:04.884378 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:04.900522 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Getting quotas for project b68045cdaa7343e0a991a76987416ded. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 19:03:04.904416 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Getting quotas for user 70f12d37abe544eb8fa356b0f0341c08 and project b68045cdaa7343e0a991a76987416ded. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 19:03:04.960200 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Going to run 1 instances... {{(pid=124190) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 19:03:04.962393 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b1fc677-6828-433f-bca9-4d7f3c00c240',volume_size=None,volume_type=None)] {{(pid=124190) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 19:03:05.089089 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-0a686e99-5351-47ba-9f79-c155581d9a7e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.732593 Jun 20 19:03:05.094842 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 603/1210] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 19:03:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 19:03:05.100829 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6e176d07-6228-45c4-a7d8-d36441983b81 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:05.102594 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6e176d07-6228-45c4-a7d8-d36441983b81 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:05.160966 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6e176d07-6228-45c4-a7d8-d36441983b81 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:05.170509 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6e176d07-6228-45c4-a7d8-d36441983b81 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1094 microversion: 2.1 time: 0.073827 Jun 20 19:03:05.171138 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 608/1211] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:05 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:06.187138 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2a11fa33-c95b-4203-8d59-848178e3b20d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:06.187753 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2a11fa33-c95b-4203-8d59-848178e3b20d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:06.195266 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2a11fa33-c95b-4203-8d59-848178e3b20d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:06.195710 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2a11fa33-c95b-4203-8d59-848178e3b20d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:06.196482 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2a11fa33-c95b-4203-8d59-848178e3b20d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:06.196919 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2a11fa33-c95b-4203-8d59-848178e3b20d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:06.260375 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2a11fa33-c95b-4203-8d59-848178e3b20d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:06.267907 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2a11fa33-c95b-4203-8d59-848178e3b20d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1210 microversion: 2.1 time: 0.085080 Jun 20 19:03:06.268466 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 604/1212] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:06 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:07.286592 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-08d9645d-d9cc-4417-b293-a2ac7624f8ca tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:07.287614 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-08d9645d-d9cc-4417-b293-a2ac7624f8ca tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:07.295643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-08d9645d-d9cc-4417-b293-a2ac7624f8ca tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:07.296203 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-08d9645d-d9cc-4417-b293-a2ac7624f8ca tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:07.297076 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-08d9645d-d9cc-4417-b293-a2ac7624f8ca tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:07.297608 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-08d9645d-d9cc-4417-b293-a2ac7624f8ca tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:07.633174 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-08d9645d-d9cc-4417-b293-a2ac7624f8ca tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:07.640574 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-08d9645d-d9cc-4417-b293-a2ac7624f8ca tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1265 microversion: 2.1 time: 0.358134 Jun 20 19:03:07.641131 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 609/1213] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:07 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:07.675581 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-63d7e404-2c29-4b09-89b9-84a7c3b024f9 req-e2e3e9af-57d6-467b-99cd-77a65a898086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "467a3c33-0f80-4bbf-94b3-6f11a681917b", "tag": "a5cdd59d-4245-4ddd-99a4-de1035d74770"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:03:07.688770 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-63d7e404-2c29-4b09-89b9-84a7c3b024f9 req-e2e3e9af-57d6-467b-99cd-77a65a898086 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:07.689570 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-63d7e404-2c29-4b09-89b9-84a7c3b024f9 req-e2e3e9af-57d6-467b-99cd-77a65a898086 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:07.710185 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-63d7e404-2c29-4b09-89b9-84a7c3b024f9 req-e2e3e9af-57d6-467b-99cd-77a65a898086 service nova] Creating event network-changed:a5cdd59d-4245-4ddd-99a4-de1035d74770 for instance 467a3c33-0f80-4bbf-94b3-6f11a681917b on hv-cinder-83697 Jun 20 19:03:07.715968 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-63d7e404-2c29-4b09-89b9-84a7c3b024f9 req-e2e3e9af-57d6-467b-99cd-77a65a898086 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051879 Jun 20 19:03:07.716766 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 605/1214] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 19:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 19:03:08.657422 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b5cf073e-27d2-4a06-b707-dc6dc78b9986 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:08.658032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b5cf073e-27d2-4a06-b707-dc6dc78b9986 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:08.665012 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b5cf073e-27d2-4a06-b707-dc6dc78b9986 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:08.665458 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b5cf073e-27d2-4a06-b707-dc6dc78b9986 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:08.666214 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b5cf073e-27d2-4a06-b707-dc6dc78b9986 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:08.666645 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b5cf073e-27d2-4a06-b707-dc6dc78b9986 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:08.800658 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b5cf073e-27d2-4a06-b707-dc6dc78b9986 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:08.808176 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b5cf073e-27d2-4a06-b707-dc6dc78b9986 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1265 microversion: 2.1 time: 0.154641 Jun 20 19:03:08.808725 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 610/1215] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:08 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 19:03:09.825409 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-f9b2ed11-6b73-44ad-84ee-caf62fcbc714 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:09.826108 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-f9b2ed11-6b73-44ad-84ee-caf62fcbc714 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:09.832829 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f9b2ed11-6b73-44ad-84ee-caf62fcbc714 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:09.833275 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f9b2ed11-6b73-44ad-84ee-caf62fcbc714 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:09.834037 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f9b2ed11-6b73-44ad-84ee-caf62fcbc714 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:09.834470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-f9b2ed11-6b73-44ad-84ee-caf62fcbc714 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:09.959926 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-f9b2ed11-6b73-44ad-84ee-caf62fcbc714 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:09.967323 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-f9b2ed11-6b73-44ad-84ee-caf62fcbc714 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1265 microversion: 2.1 time: 0.146000 Jun 20 19:03:09.967817 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 606/1216] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:09 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:10.983914 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a61d057a-c986-4605-a389-122fab7903c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:10.984518 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a61d057a-c986-4605-a389-122fab7903c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:10.991581 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a61d057a-c986-4605-a389-122fab7903c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:10.992023 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a61d057a-c986-4605-a389-122fab7903c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:10.992775 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a61d057a-c986-4605-a389-122fab7903c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:10.993203 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a61d057a-c986-4605-a389-122fab7903c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:11.123231 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a61d057a-c986-4605-a389-122fab7903c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:11.130587 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a61d057a-c986-4605-a389-122fab7903c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1265 microversion: 2.1 time: 0.150501 Jun 20 19:03:11.131299 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 611/1217] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:10 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:12.147330 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-888ea517-c80d-404c-aafc-c5746de26a42 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:12.147940 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-888ea517-c80d-404c-aafc-c5746de26a42 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:12.154412 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-888ea517-c80d-404c-aafc-c5746de26a42 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:12.154858 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-888ea517-c80d-404c-aafc-c5746de26a42 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:12.155646 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-888ea517-c80d-404c-aafc-c5746de26a42 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:12.156078 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-888ea517-c80d-404c-aafc-c5746de26a42 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:12.285001 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-888ea517-c80d-404c-aafc-c5746de26a42 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:12.292979 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-888ea517-c80d-404c-aafc-c5746de26a42 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1265 microversion: 2.1 time: 0.149555 Jun 20 19:03:12.293538 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 607/1218] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:12 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:13.310570 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ddb52a5c-2d74-4aeb-8204-db631c797f79 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:13.311209 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ddb52a5c-2d74-4aeb-8204-db631c797f79 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:13.317747 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ddb52a5c-2d74-4aeb-8204-db631c797f79 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:13.318184 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ddb52a5c-2d74-4aeb-8204-db631c797f79 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:13.318937 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ddb52a5c-2d74-4aeb-8204-db631c797f79 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:13.319389 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ddb52a5c-2d74-4aeb-8204-db631c797f79 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:13.446793 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ddb52a5c-2d74-4aeb-8204-db631c797f79 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:13.454258 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ddb52a5c-2d74-4aeb-8204-db631c797f79 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1265 microversion: 2.1 time: 0.147538 Jun 20 19:03:13.454813 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 612/1219] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:13 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:14.471501 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-06afee2e-f06a-4586-8512-648e4e3cd852 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:14.472136 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-06afee2e-f06a-4586-8512-648e4e3cd852 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:14.479178 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-06afee2e-f06a-4586-8512-648e4e3cd852 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:14.479625 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-06afee2e-f06a-4586-8512-648e4e3cd852 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:14.480373 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-06afee2e-f06a-4586-8512-648e4e3cd852 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:14.480804 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-06afee2e-f06a-4586-8512-648e4e3cd852 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:14.609071 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-06afee2e-f06a-4586-8512-648e4e3cd852 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:14.617010 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-06afee2e-f06a-4586-8512-648e4e3cd852 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1265 microversion: 2.1 time: 0.149399 Jun 20 19:03:14.617573 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 608/1220] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:14 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:15.633267 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-a1d5cc23-4e51-4cbc-8315-51ec2cb8aa95 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:15.633816 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-a1d5cc23-4e51-4cbc-8315-51ec2cb8aa95 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:15.636125 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=2 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:03:15.641443 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a1d5cc23-4e51-4cbc-8315-51ec2cb8aa95 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:15.641887 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a1d5cc23-4e51-4cbc-8315-51ec2cb8aa95 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:15.642634 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a1d5cc23-4e51-4cbc-8315-51ec2cb8aa95 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:15.643102 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-a1d5cc23-4e51-4cbc-8315-51ec2cb8aa95 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:15.773997 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-a1d5cc23-4e51-4cbc-8315-51ec2cb8aa95 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:15.781361 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-a1d5cc23-4e51-4cbc-8315-51ec2cb8aa95 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1265 microversion: 2.1 time: 0.152042 Jun 20 19:03:15.781924 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 613/1221] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:15 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:16.798534 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-23b798cb-5803-4a21-b4ce-9dc9dea098eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:16.799162 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-23b798cb-5803-4a21-b4ce-9dc9dea098eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:16.801343 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:03:16.802066 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=6 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:03:16.808566 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-23b798cb-5803-4a21-b4ce-9dc9dea098eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:16.808949 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-23b798cb-5803-4a21-b4ce-9dc9dea098eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:16.809698 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-23b798cb-5803-4a21-b4ce-9dc9dea098eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:16.810128 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-23b798cb-5803-4a21-b4ce-9dc9dea098eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:16.939080 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-23b798cb-5803-4a21-b4ce-9dc9dea098eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:16.946953 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-23b798cb-5803-4a21-b4ce-9dc9dea098eb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1265 microversion: 2.1 time: 0.152265 Jun 20 19:03:16.947509 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 609/1222] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:16 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:17.296345 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-84dcdf94-c1ff-4e0a-9590-3966beeeddd8 req-68dd7657-b9b3-48b1-a09d-216d4f4c57b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467a3c33-0f80-4bbf-94b3-6f11a681917b", "name": "network-vif-plugged", "status": "completed", "tag": "a5cdd59d-4245-4ddd-99a4-de1035d74770"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:03:17.305788 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-84dcdf94-c1ff-4e0a-9590-3966beeeddd8 req-68dd7657-b9b3-48b1-a09d-216d4f4c57b9 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:17.306305 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-84dcdf94-c1ff-4e0a-9590-3966beeeddd8 req-68dd7657-b9b3-48b1-a09d-216d4f4c57b9 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:17.317318 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-84dcdf94-c1ff-4e0a-9590-3966beeeddd8 req-68dd7657-b9b3-48b1-a09d-216d4f4c57b9 service nova] Creating event network-vif-plugged:a5cdd59d-4245-4ddd-99a4-de1035d74770 for instance 467a3c33-0f80-4bbf-94b3-6f11a681917b on hv-cinder-83697 Jun 20 19:03:17.321409 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR oslo.messaging._drivers.impl_rabbit [req-84dcdf94-c1ff-4e0a-9590-3966beeeddd8 req-68dd7657-b9b3-48b1-a09d-216d4f4c57b9 service nova] [d4fb8758-9b43-49d5-80b5-5161f3ff3a63] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 19:03:17.962480 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-5b9585a2-4a64-416c-a05f-0249212072c0 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:17.963117 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-5b9585a2-4a64-416c-a05f-0249212072c0 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:17.969620 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5b9585a2-4a64-416c-a05f-0249212072c0 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:17.970023 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5b9585a2-4a64-416c-a05f-0249212072c0 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:17.970759 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5b9585a2-4a64-416c-a05f-0249212072c0 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:17.971214 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-5b9585a2-4a64-416c-a05f-0249212072c0 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:18.100476 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-5b9585a2-4a64-416c-a05f-0249212072c0 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:18.108052 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-5b9585a2-4a64-416c-a05f-0249212072c0 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1265 microversion: 2.1 time: 0.149178 Jun 20 19:03:18.108650 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 610/1223] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:17 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 19:03:18.329441 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [req-84dcdf94-c1ff-4e0a-9590-3966beeeddd8 req-68dd7657-b9b3-48b1-a09d-216d4f4c57b9 service nova] [d4fb8758-9b43-49d5-80b5-5161f3ff3a63] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 59714. Jun 20 19:03:18.332873 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-84dcdf94-c1ff-4e0a-9590-3966beeeddd8 req-68dd7657-b9b3-48b1-a09d-216d4f4c57b9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.040509 Jun 20 19:03:18.334100 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 614/1224] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 19:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 19:03:19.124279 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-e9d0a4ba-3602-428c-ab75-790b3235a039 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:19.124889 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-e9d0a4ba-3602-428c-ab75-790b3235a039 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:19.131360 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e9d0a4ba-3602-428c-ab75-790b3235a039 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:19.131814 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e9d0a4ba-3602-428c-ab75-790b3235a039 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:19.132573 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e9d0a4ba-3602-428c-ab75-790b3235a039 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:19.133012 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-e9d0a4ba-3602-428c-ab75-790b3235a039 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:19.262211 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-e9d0a4ba-3602-428c-ab75-790b3235a039 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:19.269552 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-e9d0a4ba-3602-428c-ab75-790b3235a039 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1265 microversion: 2.1 time: 0.149118 Jun 20 19:03:19.270102 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 611/1225] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:19 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:20.287790 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-fba03d46-cce0-4f56-93c3-d139c1de2b35 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:20.288491 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-fba03d46-cce0-4f56-93c3-d139c1de2b35 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:20.294825 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fba03d46-cce0-4f56-93c3-d139c1de2b35 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:20.295308 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fba03d46-cce0-4f56-93c3-d139c1de2b35 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:20.296062 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fba03d46-cce0-4f56-93c3-d139c1de2b35 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:20.296500 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-fba03d46-cce0-4f56-93c3-d139c1de2b35 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:20.428767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-fba03d46-cce0-4f56-93c3-d139c1de2b35 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:20.436240 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-fba03d46-cce0-4f56-93c3-d139c1de2b35 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1453 microversion: 2.1 time: 0.153783 Jun 20 19:03:20.436801 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 615/1226] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:20 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:20.452395 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7c83b6e0-a95a-4b84-b0cf-9b2cf3b5e8ab tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:03:20.453012 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7c83b6e0-a95a-4b84-b0cf-9b2cf3b5e8ab tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:03:20.459884 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c83b6e0-a95a-4b84-b0cf-9b2cf3b5e8ab tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:20.460363 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c83b6e0-a95a-4b84-b0cf-9b2cf3b5e8ab tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:20.461121 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c83b6e0-a95a-4b84-b0cf-9b2cf3b5e8ab tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:20.461554 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7c83b6e0-a95a-4b84-b0cf-9b2cf3b5e8ab tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:20.591034 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7c83b6e0-a95a-4b84-b0cf-9b2cf3b5e8ab tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:03:20.598476 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7c83b6e0-a95a-4b84-b0cf-9b2cf3b5e8ab tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1453 microversion: 2.1 time: 0.149851 Jun 20 19:03:20.599116 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 612/1227] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:03:20 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:03:21.482995 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:03:21.483518 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Mon Jun 20 19:03:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:03:22.134754 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-e8430494-a426-49f5-a217-f68a2df1c50a req-78e43a31-036e-49b9-88a1-10e3b3313d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "467a3c33-0f80-4bbf-94b3-6f11a681917b", "tag": "a5cdd59d-4245-4ddd-99a4-de1035d74770"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:03:22.143958 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-e8430494-a426-49f5-a217-f68a2df1c50a req-78e43a31-036e-49b9-88a1-10e3b3313d01 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:03:22.144523 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-e8430494-a426-49f5-a217-f68a2df1c50a req-78e43a31-036e-49b9-88a1-10e3b3313d01 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:03:22.155952 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-e8430494-a426-49f5-a217-f68a2df1c50a req-78e43a31-036e-49b9-88a1-10e3b3313d01 service nova] Creating event network-changed:a5cdd59d-4245-4ddd-99a4-de1035d74770 for instance 467a3c33-0f80-4bbf-94b3-6f11a681917b on hv-cinder-83697 Jun 20 19:03:22.161712 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-e8430494-a426-49f5-a217-f68a2df1c50a req-78e43a31-036e-49b9-88a1-10e3b3313d01 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030221 Jun 20 19:03:22.162562 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 616/1228] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 19:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 19:05:25.238658 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:05:25.239535 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:05:25.243569 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-28866564", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-339444055", "security_groups": [{"name": "tempest-secgroup-smoke-997610182"}], "block_device_mapping_v2": [{"uuid": "e632af90-ac11-4a04-98bb-bec8cba53664", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7f2c5ab-61b6-4dcc-9f9d-3b9d75a153bb"}]}} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:05:25.355609 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.network.neutron [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] validate_networks() for [('e7f2c5ab-61b6-4dcc-9f9d-3b9d75a153bb', None, None, None, None, None)] {{(pid=124190) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 19:05:25.711516 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Flavor limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 19:05:25.711936 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Image limits 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 19:05:25.712403 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Flavor pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 19:05:25.712805 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Image pref 0:0:0 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 19:05:25.713211 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.virt.hardware [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 19:05:25.722238 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:25.722686 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:25.723523 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:25.724265 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:25.742470 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Getting quotas for project b68045cdaa7343e0a991a76987416ded. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 19:05:25.746399 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.quota [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Getting quotas for user 70f12d37abe544eb8fa356b0f0341c08 and project b68045cdaa7343e0a991a76987416ded. Resources: {'cores', 'ram', 'instances'} {{(pid=124190) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 19:05:25.803449 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Going to run 1 instances... {{(pid=124190) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 19:05:25.805515 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e632af90-ac11-4a04-98bb-bec8cba53664',volume_size=None,volume_type=None)] {{(pid=124190) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 19:05:25.928175 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-249500bb-f655-4a8c-afb5-096edbfc56c6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.691021 Jun 20 19:05:25.928824 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 613/1229] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jun 20 19:05:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 19:05:25.937040 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3beabe7-1367-488a-a1bc-9e490e45a7fa] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 20 19:05:25.937635 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=26 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:05:25.938517 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=54 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:05:25.943430 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-5befa0a7-0698-491a-a143-17942322682b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:25.944898 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-5befa0a7-0698-491a-a143-17942322682b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:25.996983 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-5befa0a7-0698-491a-a143-17942322682b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:26.003976 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-5befa0a7-0698-491a-a143-17942322682b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1092 microversion: 2.1 time: 0.068405 Jun 20 19:05:26.004539 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 617/1230] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:25 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1092 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:27.021155 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c1a817ef-3e65-4cf5-a361-88db8ba0c351 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:27.021766 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c1a817ef-3e65-4cf5-a361-88db8ba0c351 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:27.075206 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c1a817ef-3e65-4cf5-a361-88db8ba0c351 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:27.081888 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c1a817ef-3e65-4cf5-a361-88db8ba0c351 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1092 microversion: 2.1 time: 0.065116 Jun 20 19:05:27.082436 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 614/1231] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:27 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1092 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:28.097930 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1d2757c7-43fc-419a-b9bd-03aebe8417a0 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:28.098543 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1d2757c7-43fc-419a-b9bd-03aebe8417a0 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:28.123869 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3beabe7-1367-488a-a1bc-9e490e45a7fa] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 59830. Jun 20 19:05:28.153521 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1d2757c7-43fc-419a-b9bd-03aebe8417a0 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:28.160643 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1d2757c7-43fc-419a-b9bd-03aebe8417a0 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1092 microversion: 2.1 time: 0.067025 Jun 20 19:05:28.161382 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 618/1232] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:28 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1092 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:29.178232 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8015e507-8fdb-4ce1-baaa-d29cd8d86846 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:29.178843 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8015e507-8fdb-4ce1-baaa-d29cd8d86846 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:29.231467 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8015e507-8fdb-4ce1-baaa-d29cd8d86846 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:29.238044 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8015e507-8fdb-4ce1-baaa-d29cd8d86846 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1092 microversion: 2.1 time: 0.064524 Jun 20 19:05:29.238621 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 615/1233] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:29 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1092 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:30.254729 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-1e5055c0-2cf3-4a6d-9911-9a6e0ac94150 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:30.255417 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-1e5055c0-2cf3-4a6d-9911-9a6e0ac94150 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:30.262067 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1e5055c0-2cf3-4a6d-9911-9a6e0ac94150 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:30.262511 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1e5055c0-2cf3-4a6d-9911-9a6e0ac94150 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:30.263294 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1e5055c0-2cf3-4a6d-9911-9a6e0ac94150 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:30.263725 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-1e5055c0-2cf3-4a6d-9911-9a6e0ac94150 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:30.328038 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-1e5055c0-2cf3-4a6d-9911-9a6e0ac94150 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:30.336245 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-1e5055c0-2cf3-4a6d-9911-9a6e0ac94150 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1142 microversion: 2.1 time: 0.085971 Jun 20 19:05:30.336807 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 619/1234] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:30 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1142 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:31.353045 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-c89efa4e-ecbd-405c-ab7f-15bf01acdc1e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:31.353558 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-c89efa4e-ecbd-405c-ab7f-15bf01acdc1e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:31.362237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c89efa4e-ecbd-405c-ab7f-15bf01acdc1e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:31.362237 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c89efa4e-ecbd-405c-ab7f-15bf01acdc1e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:31.362660 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c89efa4e-ecbd-405c-ab7f-15bf01acdc1e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:31.363843 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-c89efa4e-ecbd-405c-ab7f-15bf01acdc1e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:31.430334 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-c89efa4e-ecbd-405c-ab7f-15bf01acdc1e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:31.437770 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-c89efa4e-ecbd-405c-ab7f-15bf01acdc1e tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1208 microversion: 2.1 time: 0.088764 Jun 20 19:05:31.438334 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 616/1235] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:31 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1208 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:32.455585 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-ebea0017-408d-4027-a5ea-4da1b8e9531a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:32.456329 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-ebea0017-408d-4027-a5ea-4da1b8e9531a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:32.462658 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ebea0017-408d-4027-a5ea-4da1b8e9531a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:32.463207 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ebea0017-408d-4027-a5ea-4da1b8e9531a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:32.464059 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ebea0017-408d-4027-a5ea-4da1b8e9531a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:32.464564 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-ebea0017-408d-4027-a5ea-4da1b8e9531a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:32.656079 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-ebea0017-408d-4027-a5ea-4da1b8e9531a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:32.664642 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-ebea0017-408d-4027-a5ea-4da1b8e9531a tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1263 microversion: 2.1 time: 0.213782 Jun 20 19:05:32.665206 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 620/1236] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:32 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1263 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:32.987270 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-fcc7728c-1d30-49aa-bc00-7e4d1e53a83c req-29b16c0b-3135-4bbd-ac5f-ed9d0dd6c757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "870782bf-817a-4e6f-94b5-2b7752effe96", "tag": "b8ffdbc9-3ceb-4ebd-b5d7-ed61a7484b2c"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:05:33.000906 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-fcc7728c-1d30-49aa-bc00-7e4d1e53a83c req-29b16c0b-3135-4bbd-ac5f-ed9d0dd6c757 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:33.001347 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-fcc7728c-1d30-49aa-bc00-7e4d1e53a83c req-29b16c0b-3135-4bbd-ac5f-ed9d0dd6c757 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:33.015646 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-fcc7728c-1d30-49aa-bc00-7e4d1e53a83c req-29b16c0b-3135-4bbd-ac5f-ed9d0dd6c757 service nova] Creating event network-changed:b8ffdbc9-3ceb-4ebd-b5d7-ed61a7484b2c for instance 870782bf-817a-4e6f-94b5-2b7752effe96 on hv-cinder-83697 Jun 20 19:05:33.021330 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-fcc7728c-1d30-49aa-bc00-7e4d1e53a83c req-29b16c0b-3135-4bbd-ac5f-ed9d0dd6c757 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105875 Jun 20 19:05:33.022087 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 617/1237] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 19:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 19:05:33.682464 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-4897d331-8e13-487c-985c-dcac09d258f3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:33.683041 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-4897d331-8e13-487c-985c-dcac09d258f3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:33.689075 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4897d331-8e13-487c-985c-dcac09d258f3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:33.689515 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4897d331-8e13-487c-985c-dcac09d258f3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:33.690256 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4897d331-8e13-487c-985c-dcac09d258f3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:33.690766 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-4897d331-8e13-487c-985c-dcac09d258f3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:33.824676 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-4897d331-8e13-487c-985c-dcac09d258f3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:33.832144 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-4897d331-8e13-487c-985c-dcac09d258f3 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1263 microversion: 2.1 time: 0.153908 Jun 20 19:05:33.832703 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 621/1238] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:33 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:34.849538 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-bcb34c5f-b618-42c2-9875-fb0707eec124 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:34.850165 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-bcb34c5f-b618-42c2-9875-fb0707eec124 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:34.856871 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bcb34c5f-b618-42c2-9875-fb0707eec124 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:34.857325 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bcb34c5f-b618-42c2-9875-fb0707eec124 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:34.858087 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bcb34c5f-b618-42c2-9875-fb0707eec124 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:34.858527 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bcb34c5f-b618-42c2-9875-fb0707eec124 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:34.989024 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-bcb34c5f-b618-42c2-9875-fb0707eec124 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:34.996461 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-bcb34c5f-b618-42c2-9875-fb0707eec124 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1263 microversion: 2.1 time: 0.151371 Jun 20 19:05:34.997005 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 618/1239] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:34 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:36.013593 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c23d9e8d-ef7a-4e4b-9b2b-ddd949052abb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:36.014197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c23d9e8d-ef7a-4e4b-9b2b-ddd949052abb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:36.021483 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c23d9e8d-ef7a-4e4b-9b2b-ddd949052abb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:36.021932 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c23d9e8d-ef7a-4e4b-9b2b-ddd949052abb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:36.022721 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c23d9e8d-ef7a-4e4b-9b2b-ddd949052abb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:36.023195 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c23d9e8d-ef7a-4e4b-9b2b-ddd949052abb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:36.150367 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c23d9e8d-ef7a-4e4b-9b2b-ddd949052abb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:36.157867 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c23d9e8d-ef7a-4e4b-9b2b-ddd949052abb tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1263 microversion: 2.1 time: 0.148116 Jun 20 19:05:36.158462 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 622/1240] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:36 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:37.175092 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-7add1df4-ba11-4b00-9599-5850c283eda5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:37.176320 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-7add1df4-ba11-4b00-9599-5850c283eda5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:37.178543 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=2 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:05:37.184360 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7add1df4-ba11-4b00-9599-5850c283eda5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:37.184803 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7add1df4-ba11-4b00-9599-5850c283eda5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:37.185555 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7add1df4-ba11-4b00-9599-5850c283eda5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:37.185985 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-7add1df4-ba11-4b00-9599-5850c283eda5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:37.312814 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-7add1df4-ba11-4b00-9599-5850c283eda5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:37.320320 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-7add1df4-ba11-4b00-9599-5850c283eda5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1263 microversion: 2.1 time: 0.149094 Jun 20 19:05:37.320872 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 619/1241] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:37 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:38.337779 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-6b821843-0a66-4666-ab82-99dd8466b147 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:38.338386 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-6b821843-0a66-4666-ab82-99dd8466b147 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:38.340681 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell0:SELECT=4 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:05:38.346518 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6b821843-0a66-4666-ab82-99dd8466b147 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:38.347703 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6b821843-0a66-4666-ab82-99dd8466b147 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:38.348483 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6b821843-0a66-4666-ab82-99dd8466b147 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:38.348927 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-6b821843-0a66-4666-ab82-99dd8466b147 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:38.475274 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-6b821843-0a66-4666-ab82-99dd8466b147 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:38.482568 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-6b821843-0a66-4666-ab82-99dd8466b147 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1263 microversion: 2.1 time: 0.148742 Jun 20 19:05:38.483217 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 623/1242] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:38 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:39.499325 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-bbc1e60b-05e9-416f-a6fa-4424e8856522 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:39.499929 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-bbc1e60b-05e9-416f-a6fa-4424e8856522 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:39.502181 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell0:SELECT=10 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:05:39.508024 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bbc1e60b-05e9-416f-a6fa-4424e8856522 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:39.508471 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bbc1e60b-05e9-416f-a6fa-4424e8856522 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:39.509225 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bbc1e60b-05e9-416f-a6fa-4424e8856522 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:39.509651 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-bbc1e60b-05e9-416f-a6fa-4424e8856522 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:39.640625 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-bbc1e60b-05e9-416f-a6fa-4424e8856522 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:39.648140 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-bbc1e60b-05e9-416f-a6fa-4424e8856522 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1263 microversion: 2.1 time: 0.152705 Jun 20 19:05:39.648697 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 620/1243] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:39 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:40.664529 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-c1c72bb4-e1e4-4519-8b5b-152f87ad4c8f tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:40.665141 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-c1c72bb4-e1e4-4519-8b5b-152f87ad4c8f tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:40.671605 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c1c72bb4-e1e4-4519-8b5b-152f87ad4c8f tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:40.672051 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c1c72bb4-e1e4-4519-8b5b-152f87ad4c8f tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:40.672807 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c1c72bb4-e1e4-4519-8b5b-152f87ad4c8f tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:40.673238 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-c1c72bb4-e1e4-4519-8b5b-152f87ad4c8f tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:40.806365 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-c1c72bb4-e1e4-4519-8b5b-152f87ad4c8f tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:40.813732 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-c1c72bb4-e1e4-4519-8b5b-152f87ad4c8f tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1263 microversion: 2.1 time: 0.153055 Jun 20 19:05:40.814310 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 624/1244] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:40 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:41.830457 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-08f51aea-9c5e-456e-947c-954a843e28dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:41.831098 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-08f51aea-9c5e-456e-947c-954a843e28dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:41.837756 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-08f51aea-9c5e-456e-947c-954a843e28dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:41.838242 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-08f51aea-9c5e-456e-947c-954a843e28dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:41.839032 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-08f51aea-9c5e-456e-947c-954a843e28dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:41.839473 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-08f51aea-9c5e-456e-947c-954a843e28dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:41.968861 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-08f51aea-9c5e-456e-947c-954a843e28dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:41.977238 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-08f51aea-9c5e-456e-947c-954a843e28dc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1263 microversion: 2.1 time: 0.150613 Jun 20 19:05:41.977962 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 621/1245] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:41 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:42.994535 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-26b5f9bd-117d-4f52-9620-26473d06f7e6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:42.995166 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-26b5f9bd-117d-4f52-9620-26473d06f7e6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:43.001570 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-26b5f9bd-117d-4f52-9620-26473d06f7e6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:43.002017 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-26b5f9bd-117d-4f52-9620-26473d06f7e6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:43.002766 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-26b5f9bd-117d-4f52-9620-26473d06f7e6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:43.003752 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-26b5f9bd-117d-4f52-9620-26473d06f7e6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:43.133924 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-26b5f9bd-117d-4f52-9620-26473d06f7e6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:43.141270 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-26b5f9bd-117d-4f52-9620-26473d06f7e6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1263 microversion: 2.1 time: 0.150605 Jun 20 19:05:43.141824 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 625/1246] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:42 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:44.157770 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-1471ad65-3825-45ce-9ac9-f4e922334c3b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:44.158381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-1471ad65-3825-45ce-9ac9-f4e922334c3b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:44.164902 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1471ad65-3825-45ce-9ac9-f4e922334c3b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:44.165350 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1471ad65-3825-45ce-9ac9-f4e922334c3b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:44.166107 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1471ad65-3825-45ce-9ac9-f4e922334c3b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:44.166543 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-1471ad65-3825-45ce-9ac9-f4e922334c3b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:44.297486 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-1471ad65-3825-45ce-9ac9-f4e922334c3b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:44.305550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-1471ad65-3825-45ce-9ac9-f4e922334c3b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1263 microversion: 2.1 time: 0.151688 Jun 20 19:05:44.306110 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 622/1247] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:44 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:45.322478 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-022275c4-47e1-4f99-ba35-5654805d34e5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:45.323117 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-022275c4-47e1-4f99-ba35-5654805d34e5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:45.329528 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-022275c4-47e1-4f99-ba35-5654805d34e5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:45.329972 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-022275c4-47e1-4f99-ba35-5654805d34e5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:45.330726 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-022275c4-47e1-4f99-ba35-5654805d34e5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:45.331187 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-022275c4-47e1-4f99-ba35-5654805d34e5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:45.461993 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-022275c4-47e1-4f99-ba35-5654805d34e5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:45.469355 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-022275c4-47e1-4f99-ba35-5654805d34e5 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1263 microversion: 2.1 time: 0.150757 Jun 20 19:05:45.469910 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 626/1248] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:45 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:45.989563 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [req-d403981f-c1b7-41c1-8371-248fc9e9743b req-c269db38-7660-42d2-8fe5-560e252f07e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "870782bf-817a-4e6f-94b5-2b7752effe96", "name": "network-vif-plugged", "status": "completed", "tag": "b8ffdbc9-3ceb-4ebd-b5d7-ed61a7484b2c"}]} {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:05:45.998705 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-d403981f-c1b7-41c1-8371-248fc9e9743b req-c269db38-7660-42d2-8fe5-560e252f07e5 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:45.999208 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [req-d403981f-c1b7-41c1-8371-248fc9e9743b req-c269db38-7660-42d2-8fe5-560e252f07e5 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:46.010532 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.compute.server_external_events [req-d403981f-c1b7-41c1-8371-248fc9e9743b req-c269db38-7660-42d2-8fe5-560e252f07e5 service nova] Creating event network-vif-plugged:b8ffdbc9-3ceb-4ebd-b5d7-ed61a7484b2c for instance 870782bf-817a-4e6f-94b5-2b7752effe96 on hv-cinder-83697 Jun 20 19:05:46.015729 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [req-d403981f-c1b7-41c1-8371-248fc9e9743b req-c269db38-7660-42d2-8fe5-560e252f07e5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084036 Jun 20 19:05:46.016302 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 623/1249] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 19:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 19:05:46.485495 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-74c044ed-3d08-4ece-929d-e048b7c76727 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:46.486095 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-74c044ed-3d08-4ece-929d-e048b7c76727 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:46.493097 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-74c044ed-3d08-4ece-929d-e048b7c76727 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:46.493539 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-74c044ed-3d08-4ece-929d-e048b7c76727 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:46.494283 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-74c044ed-3d08-4ece-929d-e048b7c76727 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:46.494710 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-74c044ed-3d08-4ece-929d-e048b7c76727 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:46.620057 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-74c044ed-3d08-4ece-929d-e048b7c76727 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:46.627336 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-74c044ed-3d08-4ece-929d-e048b7c76727 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1263 microversion: 2.1 time: 0.145658 Jun 20 19:05:46.627891 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 627/1250] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:46 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:47.645085 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-99127c9c-03ae-404f-b3e8-fae75bec49ba tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:47.645787 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-99127c9c-03ae-404f-b3e8-fae75bec49ba tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:47.652533 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-99127c9c-03ae-404f-b3e8-fae75bec49ba tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:47.652982 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-99127c9c-03ae-404f-b3e8-fae75bec49ba tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:47.653737 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-99127c9c-03ae-404f-b3e8-fae75bec49ba tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:47.654172 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-99127c9c-03ae-404f-b3e8-fae75bec49ba tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:47.784021 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-99127c9c-03ae-404f-b3e8-fae75bec49ba tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:47.791996 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-99127c9c-03ae-404f-b3e8-fae75bec49ba tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1263 microversion: 2.1 time: 0.151125 Jun 20 19:05:47.792550 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 624/1251] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:47 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:48.809447 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b3861166-7d9c-4d2e-96c3-4da6f704022b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:48.810073 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b3861166-7d9c-4d2e-96c3-4da6f704022b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:48.817110 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b3861166-7d9c-4d2e-96c3-4da6f704022b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:48.817565 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b3861166-7d9c-4d2e-96c3-4da6f704022b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:48.818292 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b3861166-7d9c-4d2e-96c3-4da6f704022b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:48.818716 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b3861166-7d9c-4d2e-96c3-4da6f704022b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:48.953312 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b3861166-7d9c-4d2e-96c3-4da6f704022b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:48.960689 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b3861166-7d9c-4d2e-96c3-4da6f704022b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1450 microversion: 2.1 time: 0.155113 Jun 20 19:05:48.961245 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 628/1252] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:48 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:48.976498 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-493d74aa-b4ab-4962-8d0b-4d4574de617b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:05:48.977046 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-493d74aa-b4ab-4962-8d0b-4d4574de617b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:05:48.983465 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-493d74aa-b4ab-4962-8d0b-4d4574de617b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:48.983911 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-493d74aa-b4ab-4962-8d0b-4d4574de617b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:48.984669 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-493d74aa-b4ab-4962-8d0b-4d4574de617b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:48.985109 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-493d74aa-b4ab-4962-8d0b-4d4574de617b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:49.117005 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-493d74aa-b4ab-4962-8d0b-4d4574de617b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:05:49.124449 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-493d74aa-b4ab-4962-8d0b-4d4574de617b tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1450 microversion: 2.1 time: 0.151811 Jun 20 19:05:49.125003 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 625/1253] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:05:48 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:05:50.999998 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-b5d02d88-3189-45e0-94b8-6e536f107f5d req-ddb33f6e-a14c-4106-95a2-9ecd685565b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "870782bf-817a-4e6f-94b5-2b7752effe96", "tag": "b8ffdbc9-3ceb-4ebd-b5d7-ed61a7484b2c"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:05:51.008442 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-b5d02d88-3189-45e0-94b8-6e536f107f5d req-ddb33f6e-a14c-4106-95a2-9ecd685565b3 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:05:51.008962 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-b5d02d88-3189-45e0-94b8-6e536f107f5d req-ddb33f6e-a14c-4106-95a2-9ecd685565b3 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:05:51.020567 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-b5d02d88-3189-45e0-94b8-6e536f107f5d req-ddb33f6e-a14c-4106-95a2-9ecd685565b3 service nova] Creating event network-changed:b8ffdbc9-3ceb-4ebd-b5d7-ed61a7484b2c for instance 870782bf-817a-4e6f-94b5-2b7752effe96 on hv-cinder-83697 Jun 20 19:05:51.025675 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-b5d02d88-3189-45e0-94b8-6e536f107f5d req-ddb33f6e-a14c-4106-95a2-9ecd685565b3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077519 Jun 20 19:05:51.026295 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 629/1254] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 19:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 19:06:11.726578 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:06:11.727086 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Mon Jun 20 19:06:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:06:21.540569 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:06:21.541173 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Mon Jun 20 19:06:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:06:41.492875 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:06:41.493534 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Mon Jun 20 19:06:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:07:55.166945 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:07:55.168540 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG dbcounter [-] [124190] Writing DB stats nova_cell1:SELECT=54 {{(pid=124190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:07:55.170214 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3beabe7-1367-488a-a1bc-9e490e45a7fa] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 20 19:07:55.171032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_api:SELECT=30 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:07:55.172079 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG dbcounter [-] [124189] Writing DB stats nova_cell1:SELECT=62 {{(pid=124189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:07:55.174705 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-38471da5-b2a8-4d6d-8612-158ddc9bcb71 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:07:55.175296 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-38471da5-b2a8-4d6d-8612-158ddc9bcb71 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:07:55.177828 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-001afa7b-6fd1-4c51-ae51-17cfc7f92024 req-17f1433d-ca54-465d-985a-5b871abc0020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "870782bf-817a-4e6f-94b5-2b7752effe96", "tag": "b8ffdbc9-3ceb-4ebd-b5d7-ed61a7484b2c"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:07:55.183277 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-38471da5-b2a8-4d6d-8612-158ddc9bcb71 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:07:55.183914 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-38471da5-b2a8-4d6d-8612-158ddc9bcb71 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:07:55.184746 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-38471da5-b2a8-4d6d-8612-158ddc9bcb71 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:07:55.185254 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-38471da5-b2a8-4d6d-8612-158ddc9bcb71 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:07:55.188504 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-001afa7b-6fd1-4c51-ae51-17cfc7f92024 req-17f1433d-ca54-465d-985a-5b871abc0020 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:07:55.188968 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-001afa7b-6fd1-4c51-ae51-17cfc7f92024 req-17f1433d-ca54-465d-985a-5b871abc0020 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:07:55.200077 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-001afa7b-6fd1-4c51-ae51-17cfc7f92024 req-17f1433d-ca54-465d-985a-5b871abc0020 service nova] Creating event network-changed:b8ffdbc9-3ceb-4ebd-b5d7-ed61a7484b2c for instance 870782bf-817a-4e6f-94b5-2b7752effe96 on hv-cinder-83697 Jun 20 19:07:55.205431 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-001afa7b-6fd1-4c51-ae51-17cfc7f92024 req-17f1433d-ca54-465d-985a-5b871abc0020 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038635 Jun 20 19:07:55.206425 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 630/1255] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 19:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 19:07:55.211285 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-38471da5-b2a8-4d6d-8612-158ddc9bcb71 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 19:07:55.300241 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-38471da5-b2a8-4d6d-8612-158ddc9bcb71 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "DELETE /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 204 len: 0 microversion: 2.1 time: 0.134974 Jun 20 19:07:55.304110 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 626/1256] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 19:07:55 2022] DELETE /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 19:07:55.310862 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-b205c787-4820-42cb-a08a-7875775867bc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:07:55.311640 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-b205c787-4820-42cb-a08a-7875775867bc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:07:55.318736 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b205c787-4820-42cb-a08a-7875775867bc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:07:55.319222 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b205c787-4820-42cb-a08a-7875775867bc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:07:55.320163 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b205c787-4820-42cb-a08a-7875775867bc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:07:55.320465 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-b205c787-4820-42cb-a08a-7875775867bc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:07:55.476482 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-b205c787-4820-42cb-a08a-7875775867bc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:07:55.490188 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-b205c787-4820-42cb-a08a-7875775867bc tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1575 microversion: 2.1 time: 0.184750 Jun 20 19:07:55.492548 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 631/1257] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:07:55 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 19:07:56.509662 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-ce84bd2b-966e-44cc-af93-639dbbd2e064 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:07:56.510365 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-ce84bd2b-966e-44cc-af93-639dbbd2e064 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:07:56.517000 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce84bd2b-966e-44cc-af93-639dbbd2e064 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:07:56.517444 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce84bd2b-966e-44cc-af93-639dbbd2e064 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:07:56.518210 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce84bd2b-966e-44cc-af93-639dbbd2e064 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:07:56.518647 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-ce84bd2b-966e-44cc-af93-639dbbd2e064 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:07:56.651816 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-ce84bd2b-966e-44cc-af93-639dbbd2e064 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:07:56.659835 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-ce84bd2b-966e-44cc-af93-639dbbd2e064 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1575 microversion: 2.1 time: 0.154549 Jun 20 19:07:56.660381 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 627/1258] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:07:56 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:07:57.579128 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-bab11782-6b5a-43e2-b15d-358ce3bc2e54 req-c3b0ae89-c227-4f94-a78f-8c9e8156944e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "870782bf-817a-4e6f-94b5-2b7752effe96", "name": "network-vif-deleted", "tag": "b8ffdbc9-3ceb-4ebd-b5d7-ed61a7484b2c"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:07:57.589360 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-bab11782-6b5a-43e2-b15d-358ce3bc2e54 req-c3b0ae89-c227-4f94-a78f-8c9e8156944e service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:07:57.589799 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-bab11782-6b5a-43e2-b15d-358ce3bc2e54 req-c3b0ae89-c227-4f94-a78f-8c9e8156944e service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:07:57.602129 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-bab11782-6b5a-43e2-b15d-358ce3bc2e54 req-c3b0ae89-c227-4f94-a78f-8c9e8156944e service nova] Creating event network-vif-deleted:b8ffdbc9-3ceb-4ebd-b5d7-ed61a7484b2c for instance 870782bf-817a-4e6f-94b5-2b7752effe96 on hv-cinder-83697 Jun 20 19:07:57.607746 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-bab11782-6b5a-43e2-b15d-358ce3bc2e54 req-c3b0ae89-c227-4f94-a78f-8c9e8156944e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032120 Jun 20 19:07:57.608968 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 632/1259] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 19:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 19:07:57.677026 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8606a13f-f743-42ce-9752-8954b3572ab7 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:07:57.677661 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-8606a13f-f743-42ce-9752-8954b3572ab7 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:07:57.684444 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8606a13f-f743-42ce-9752-8954b3572ab7 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:07:57.684893 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8606a13f-f743-42ce-9752-8954b3572ab7 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:07:57.685659 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8606a13f-f743-42ce-9752-8954b3572ab7 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:07:57.686097 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-8606a13f-f743-42ce-9752-8954b3572ab7 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:07:57.750259 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-8606a13f-f743-42ce-9752-8954b3572ab7 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:07:57.758560 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8606a13f-f743-42ce-9752-8954b3572ab7 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 200 len: 1223 microversion: 2.1 time: 0.085989 Jun 20 19:07:57.759158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 628/1260] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:07:57 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:07:58.776049 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-40863170-f819-456b-aac4-a075b67edc1d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:07:58.776767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-40863170-f819-456b-aac4-a075b67edc1d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 870782bf-817a-4e6f-94b5-2b7752effe96] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:07:58.778890 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3beabe7-1367-488a-a1bc-9e490e45a7fa] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 59958. Jun 20 19:07:58.783937 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-40863170-f819-456b-aac4-a075b67edc1d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:07:58.784383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-40863170-f819-456b-aac4-a075b67edc1d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:07:58.785134 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-40863170-f819-456b-aac4-a075b67edc1d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:07:58.785567 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-40863170-f819-456b-aac4-a075b67edc1d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:07:58.798552 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-40863170-f819-456b-aac4-a075b67edc1d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] HTTP exception thrown: Instance 870782bf-817a-4e6f-94b5-2b7752effe96 could not be found. Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-40863170-f819-456b-aac4-a075b67edc1d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Request method failure captured: Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 HTTP/1.1 Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMOzmMUSeumSLDS80wR3hK9mAWokj-FNYnsoMD6Vqy5EGaX_OlKNbeCMgQCL65-B9IXSHsTlExgBj-OpSqLtV4IU4h9c45CjpDPVQLAoECXqYW99ndlsvpF3fqXp6d9Lapj4JNhrPMKMnw-P8gaIQzJ0nIAJuXEQNRfkMrjMkxVwDeI Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: b68045cdaa7343e0a991a76987416ded Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 19:07:58.800177 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 19:07:58.801925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b68045cdaa7343e0a991a76987416ded", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b68045cdaa7343e0a991a76987416ded"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b68045cdaa7343e0a991a76987416ded"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b68045cdaa7343e0a991a76987416ded"}]}] Jun 20 19:07:58.801925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:07:58.801925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: b68045cdaa7343e0a991a76987416ded Jun 20 19:07:58.801925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:07:58.801925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-TestVolumeBootPattern-1070629529-project Jun 20 19:07:58.801925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 19:07:58.801925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 19:07:58.801925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 70f12d37abe544eb8fa356b0f0341c08 Jun 20 19:07:58.801925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-TestVolumeBootPattern-1070629529-project Jun 20 19:07:58.801925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 19:07:58.801925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance 870782bf-817a-4e6f-94b5-2b7752effe96 could not be found. Jun 20 19:07:58.801925 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '870782bf-817a-4e6f-94b5-2b7752effe96'} Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 870782bf-817a-4e6f-94b5-2b7752effe96 could not be found. Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 19:07:58.803130 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 870782bf-817a-4e6f-94b5-2b7752effe96 could not be found. Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 870782bf-817a-4e6f-94b5-2b7752effe96 could not be found. Jun 20 19:07:58.804835 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:07:58.806903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-40863170-f819-456b-aac4-a075b67edc1d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Returning 404 to user: Instance 870782bf-817a-4e6f-94b5-2b7752effe96 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 19:07:58.806903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-40863170-f819-456b-aac4-a075b67edc1d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96" status: 404 len: 111 microversion: 2.1 time: 0.029708 Jun 20 19:07:58.806903 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 633/1261] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:07:58 2022] GET /compute/v2.1/servers/870782bf-817a-4e6f-94b5-2b7752effe96 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 19:08:00.962386 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:08:00.962988 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Mon Jun 20 19:08:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:08:02.110230 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-9772c98b-211b-433f-936d-7e8b08c105be tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:08:02.111407 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9772c98b-211b-433f-936d-7e8b08c105be tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:08:02.117808 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9772c98b-211b-433f-936d-7e8b08c105be tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:02.118513 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9772c98b-211b-433f-936d-7e8b08c105be tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:02.118958 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-7fe96153-0d85-443b-b4c8-56eda8fa087a req-c7d5e0a8-74d9-4909-8962-9ad45372ea14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "467a3c33-0f80-4bbf-94b3-6f11a681917b", "tag": "a5cdd59d-4245-4ddd-99a4-de1035d74770"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:08:02.119404 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9772c98b-211b-433f-936d-7e8b08c105be tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:02.119753 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-9772c98b-211b-433f-936d-7e8b08c105be tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:02.127272 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-7fe96153-0d85-443b-b4c8-56eda8fa087a req-c7d5e0a8-74d9-4909-8962-9ad45372ea14 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:02.127716 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-7fe96153-0d85-443b-b4c8-56eda8fa087a req-c7d5e0a8-74d9-4909-8962-9ad45372ea14 service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:02.140961 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-7fe96153-0d85-443b-b4c8-56eda8fa087a req-c7d5e0a8-74d9-4909-8962-9ad45372ea14 service nova] Creating event network-changed:a5cdd59d-4245-4ddd-99a4-de1035d74770 for instance 467a3c33-0f80-4bbf-94b3-6f11a681917b on hv-cinder-83697 Jun 20 19:08:02.146514 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-9772c98b-211b-433f-936d-7e8b08c105be tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Going to try to terminate instance {{(pid=124190) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 19:08:02.146707 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-7fe96153-0d85-443b-b4c8-56eda8fa087a req-c7d5e0a8-74d9-4909-8962-9ad45372ea14 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031084 Jun 20 19:08:02.147539 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 634/1262] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 19:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 19:08:02.230787 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-9772c98b-211b-433f-936d-7e8b08c105be tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "DELETE /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 204 len: 0 microversion: 2.1 time: 0.124156 Jun 20 19:08:02.234906 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 629/1263] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 19:08:02 2022] DELETE /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 19:08:02.245840 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-d45105e9-e423-4a80-a114-e86a315bdb28 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:08:02.246549 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-d45105e9-e423-4a80-a114-e86a315bdb28 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:08:02.253383 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d45105e9-e423-4a80-a114-e86a315bdb28 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:02.253834 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d45105e9-e423-4a80-a114-e86a315bdb28 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:02.254613 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d45105e9-e423-4a80-a114-e86a315bdb28 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:02.255084 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-d45105e9-e423-4a80-a114-e86a315bdb28 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:02.453370 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.policy [None req-d45105e9-e423-4a80-a114-e86a315bdb28 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124189) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:08:02.461483 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-d45105e9-e423-4a80-a114-e86a315bdb28 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1578 microversion: 2.1 time: 0.224735 Jun 20 19:08:02.462044 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 635/1264] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:08:02 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:08:03.486543 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-3561e3c9-b2ee-463e-9636-9dd2de2fc1a6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:08:03.487280 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-3561e3c9-b2ee-463e-9636-9dd2de2fc1a6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:08:03.493822 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3561e3c9-b2ee-463e-9636-9dd2de2fc1a6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:03.494274 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3561e3c9-b2ee-463e-9636-9dd2de2fc1a6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:03.495243 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3561e3c9-b2ee-463e-9636-9dd2de2fc1a6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:03.495696 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-3561e3c9-b2ee-463e-9636-9dd2de2fc1a6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:03.683606 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-3561e3c9-b2ee-463e-9636-9dd2de2fc1a6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:08:03.691189 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-3561e3c9-b2ee-463e-9636-9dd2de2fc1a6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1578 microversion: 2.1 time: 0.215429 Jun 20 19:08:03.691765 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 630/1265] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:08:03 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1578 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:08:04.387321 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [req-5db21f31-1815-4072-914a-cf4f68bf623a req-49fbc5e9-92db-4773-adeb-eafa24c6935c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467a3c33-0f80-4bbf-94b3-6f11a681917b", "name": "network-vif-deleted", "tag": "a5cdd59d-4245-4ddd-99a4-de1035d74770"}]} {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 19:08:04.398689 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-5db21f31-1815-4072-914a-cf4f68bf623a req-49fbc5e9-92db-4773-adeb-eafa24c6935c service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:04.399219 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [req-5db21f31-1815-4072-914a-cf4f68bf623a req-49fbc5e9-92db-4773-adeb-eafa24c6935c service nova] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:04.411600 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.compute.server_external_events [req-5db21f31-1815-4072-914a-cf4f68bf623a req-49fbc5e9-92db-4773-adeb-eafa24c6935c service nova] Creating event network-vif-deleted:a5cdd59d-4245-4ddd-99a4-de1035d74770 for instance 467a3c33-0f80-4bbf-94b3-6f11a681917b on hv-cinder-83697 Jun 20 19:08:04.417729 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [req-5db21f31-1815-4072-914a-cf4f68bf623a req-49fbc5e9-92db-4773-adeb-eafa24c6935c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034472 Jun 20 19:08:04.418545 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 636/1266] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jun 20 19:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 19:08:04.708187 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-2c4a7c42-4b93-4de1-8d7a-15df5618d878 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:08:04.708938 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-2c4a7c42-4b93-4de1-8d7a-15df5618d878 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:08:04.715804 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2c4a7c42-4b93-4de1-8d7a-15df5618d878 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:04.716243 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2c4a7c42-4b93-4de1-8d7a-15df5618d878 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:04.717543 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2c4a7c42-4b93-4de1-8d7a-15df5618d878 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:04.717543 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2c4a7c42-4b93-4de1-8d7a-15df5618d878 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:04.753069 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2c4a7c42-4b93-4de1-8d7a-15df5618d878 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:04.753540 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-2c4a7c42-4b93-4de1-8d7a-15df5618d878 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:04.753996 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.objects.instance [None req-2c4a7c42-4b93-4de1-8d7a-15df5618d878 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lazy-loading 'fault' on Instance uuid 467a3c33-0f80-4bbf-94b3-6f11a681917b {{(pid=124190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 19:08:04.795373 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.policy [None req-2c4a7c42-4b93-4de1-8d7a-15df5618d878 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f12d37abe544eb8fa356b0f0341c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68045cdaa7343e0a991a76987416ded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124190) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 19:08:04.803883 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-2c4a7c42-4b93-4de1-8d7a-15df5618d878 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 200 len: 1230 microversion: 2.1 time: 0.099520 Jun 20 19:08:04.804453 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 631/1267] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:08:04 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 19:08:05.821740 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-45315934-d648-418a-b324-2616c5598090 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:08:05.822460 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-45315934-d648-418a-b324-2616c5598090 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 467a3c33-0f80-4bbf-94b3-6f11a681917b] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:08:05.829936 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-45315934-d648-418a-b324-2616c5598090 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:05.830377 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-45315934-d648-418a-b324-2616c5598090 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:05.831156 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-45315934-d648-418a-b324-2616c5598090 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:05.831583 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-45315934-d648-418a-b324-2616c5598090 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:05.844394 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-45315934-d648-418a-b324-2616c5598090 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] HTTP exception thrown: Instance 467a3c33-0f80-4bbf-94b3-6f11a681917b could not be found. Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-45315934-d648-418a-b324-2616c5598090 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Request method failure captured: Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b HTTP/1.1 Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMOzmMUSeumSLDS80wR3hK9mAWokj-FNYnsoMD6Vqy5EGaX_OlKNbeCMgQCL65-B9IXSHsTlExgBj-OpSqLtV4IU4h9c45CjpDPVQLAoECXqYW99ndlsvpF3fqXp6d9Lapj4JNhrPMKMnw-P8gaIQzJ0nIAJuXEQNRfkMrjMkxVwDeI Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: b68045cdaa7343e0a991a76987416ded Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 19:08:05.846032 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 19:08:05.847767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b68045cdaa7343e0a991a76987416ded", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b68045cdaa7343e0a991a76987416ded"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b68045cdaa7343e0a991a76987416ded"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b68045cdaa7343e0a991a76987416ded"}]}] Jun 20 19:08:05.847767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:08:05.847767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: b68045cdaa7343e0a991a76987416ded Jun 20 19:08:05.847767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:08:05.847767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-TestVolumeBootPattern-1070629529-project Jun 20 19:08:05.847767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 19:08:05.847767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 19:08:05.847767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 70f12d37abe544eb8fa356b0f0341c08 Jun 20 19:08:05.847767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-TestVolumeBootPattern-1070629529-project Jun 20 19:08:05.847767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 19:08:05.847767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance 467a3c33-0f80-4bbf-94b3-6f11a681917b could not be found. Jun 20 19:08:05.847767 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '467a3c33-0f80-4bbf-94b3-6f11a681917b'} Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 467a3c33-0f80-4bbf-94b3-6f11a681917b could not be found. Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 19:08:05.848819 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 467a3c33-0f80-4bbf-94b3-6f11a681917b could not be found. Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 467a3c33-0f80-4bbf-94b3-6f11a681917b could not be found. Jun 20 19:08:05.850783 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:08:05.852332 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-45315934-d648-418a-b324-2616c5598090 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Returning 404 to user: Instance 467a3c33-0f80-4bbf-94b3-6f11a681917b could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 19:08:05.852332 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-45315934-d648-418a-b324-2616c5598090 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b" status: 404 len: 111 microversion: 2.1 time: 0.029845 Jun 20 19:08:05.852332 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 637/1268] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:08:05 2022] GET /compute/v2.1/servers/467a3c33-0f80-4bbf-94b3-6f11a681917b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 19:08:06.278785 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b70d644d-f551-4cb8-8d20-64526bbb19f8 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:08:06.279326 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.compute.api [None req-b70d644d-f551-4cb8-8d20-64526bbb19f8 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124190) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:08:06.286399 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b70d644d-f551-4cb8-8d20-64526bbb19f8 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:06.286799 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b70d644d-f551-4cb8-8d20-64526bbb19f8 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:06.287598 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b70d644d-f551-4cb8-8d20-64526bbb19f8 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:06.288039 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG oslo_concurrency.lockutils [None req-b70d644d-f551-4cb8-8d20-64526bbb19f8 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:06.301603 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.wsgi [None req-b70d644d-f551-4cb8-8d20-64526bbb19f8 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] HTTP exception thrown: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b70d644d-f551-4cb8-8d20-64526bbb19f8 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Request method failure captured: Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: request: DELETE /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 HTTP/1.1 Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept: application/json Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Accept-Encoding: identity Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Connection: close Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Length: 0 Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Content-Type: application/json Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Host: 10.222.0.43 Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Openstack-System-Scope: None Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: User-Agent: python-urllib3/1.26.9 Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Auth-Token: gAAAAABisMOzmMUSeumSLDS80wR3hK9mAWokj-FNYnsoMD6Vqy5EGaX_OlKNbeCMgQCL65-B9IXSHsTlExgBj-OpSqLtV4IU4h9c45CjpDPVQLAoECXqYW99ndlsvpF3fqXp6d9Lapj4JNhrPMKMnw-P8gaIQzJ0nIAJuXEQNRfkMrjMkxVwDeI Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Id: None Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Domain-Name: None Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Identity-Status: Confirmed Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Is-Admin-Project: True Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Id: default Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Domain-Name: Default Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Id: b68045cdaa7343e0a991a76987416ded Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Project-Name: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Role: member,reader Jun 20 19:08:06.303299 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Roles: member,reader Jun 20 19:08:06.305019 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b68045cdaa7343e0a991a76987416ded", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b68045cdaa7343e0a991a76987416ded"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b68045cdaa7343e0a991a76987416ded"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b68045cdaa7343e0a991a76987416ded"}]}] Jun 20 19:08:06.305019 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:08:06.305019 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Id: b68045cdaa7343e0a991a76987416ded Jun 20 19:08:06.305019 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-Tenant-Name: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:08:06.305019 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User: tempest-TestVolumeBootPattern-1070629529-project Jun 20 19:08:06.305019 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Id: default Jun 20 19:08:06.305019 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Domain-Name: Default Jun 20 19:08:06.305019 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Id: 70f12d37abe544eb8fa356b0f0341c08 Jun 20 19:08:06.305019 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: X-User-Name: tempest-TestVolumeBootPattern-1070629529-project Jun 20 19:08:06.305019 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: method: > Jun 20 19:08:06.305019 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: exception: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:08:06.305019 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: action_args: {'id': '2218f1dc-73dd-45f8-bccf-844445a0cee1'} Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 19:08:06.306220 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:08:06.307860 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: ERROR nova.api.openstack.wsgi Jun 20 19:08:06.309524 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-b70d644d-f551-4cb8-8d20-64526bbb19f8 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Returning 404 to user: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. {{(pid=124190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 19:08:06.309524 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-b70d644d-f551-4cb8-8d20-64526bbb19f8 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 404 len: 111 microversion: 2.1 time: 0.029744 Jun 20 19:08:06.309524 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 632/1269] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jun 20 19:08:06 2022] DELETE /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 19:08:06.313544 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-00aa74bd-8562-4cd6-943a-45369ce6f4d6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '>' {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:08:06.314159 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.compute.api [None req-00aa74bd-8562-4cd6-943a-45369ce6f4d6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] [instance: 2218f1dc-73dd-45f8-bccf-844445a0cee1] Fetching instance by UUID {{(pid=124189) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 19:08:06.320197 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-00aa74bd-8562-4cd6-943a-45369ce6f4d6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:06.320649 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-00aa74bd-8562-4cd6-943a-45369ce6f4d6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:06.321409 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-00aa74bd-8562-4cd6-943a-45369ce6f4d6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 19:08:06.321843 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG oslo_concurrency.lockutils [None req-00aa74bd-8562-4cd6-943a-45369ce6f4d6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Lock "b70f99b2-ee8b-46f5-ad2d-1bba5d9fc9fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 19:08:06.336114 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.wsgi [None req-00aa74bd-8562-4cd6-943a-45369ce6f4d6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] HTTP exception thrown: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-00aa74bd-8562-4cd6-943a-45369ce6f4d6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Request method failure captured: Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: request: GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 HTTP/1.1 Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept: application/json Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Accept-Encoding: identity Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Connection: close Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Length: 0 Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Content-Type: application/json Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Host: 10.222.0.43 Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Openstack-System-Scope: None Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: User-Agent: python-urllib3/1.26.9 Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Auth-Token: gAAAAABisMOzmMUSeumSLDS80wR3hK9mAWokj-FNYnsoMD6Vqy5EGaX_OlKNbeCMgQCL65-B9IXSHsTlExgBj-OpSqLtV4IU4h9c45CjpDPVQLAoECXqYW99ndlsvpF3fqXp6d9Lapj4JNhrPMKMnw-P8gaIQzJ0nIAJuXEQNRfkMrjMkxVwDeI Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Id: None Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Domain-Name: None Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Identity-Status: Confirmed Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Is-Admin-Project: True Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Id: default Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Domain-Name: Default Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Id: b68045cdaa7343e0a991a76987416ded Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Project-Name: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Role: member,reader Jun 20 19:08:06.337842 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Roles: member,reader Jun 20 19:08:06.339563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b68045cdaa7343e0a991a76987416ded", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b68045cdaa7343e0a991a76987416ded"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b68045cdaa7343e0a991a76987416ded"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b68045cdaa7343e0a991a76987416ded"}]}] Jun 20 19:08:06.339563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:08:06.339563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Id: b68045cdaa7343e0a991a76987416ded Jun 20 19:08:06.339563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-Tenant-Name: tempest-TestVolumeBootPattern-1070629529 Jun 20 19:08:06.339563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User: tempest-TestVolumeBootPattern-1070629529-project Jun 20 19:08:06.339563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Id: default Jun 20 19:08:06.339563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Domain-Name: Default Jun 20 19:08:06.339563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Id: 70f12d37abe544eb8fa356b0f0341c08 Jun 20 19:08:06.339563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: X-User-Name: tempest-TestVolumeBootPattern-1070629529-project Jun 20 19:08:06.339563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: method: > Jun 20 19:08:06.339563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: exception: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:08:06.339563 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: action_args: {'id': '2218f1dc-73dd-45f8-bccf-844445a0cee1'} Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: {{(pid=124189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 19:08:06.340455 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. Jun 20 19:08:06.342009 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: ERROR nova.api.openstack.wsgi Jun 20 19:08:06.343419 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: DEBUG nova.api.openstack.wsgi [None req-00aa74bd-8562-4cd6-943a-45369ce6f4d6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Returning 404 to user: Instance 2218f1dc-73dd-45f8-bccf-844445a0cee1 could not be found. {{(pid=124189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 19:08:06.343419 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO nova.api.openstack.requestlog [None req-00aa74bd-8562-4cd6-943a-45369ce6f4d6 tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1" status: 404 len: 111 microversion: 2.1 time: 0.029595 Jun 20 19:08:06.343419 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: [pid: 124189|app: 0|req: 638/1270] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jun 20 19:08:06 2022] GET /compute/v2.1/servers/2218f1dc-73dd-45f8-bccf-844445a0cee1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 19:08:07.623677 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: DEBUG nova.api.openstack.wsgi [None req-8238c7e0-c49c-4d2d-8cd0-a02e300c617d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] Calling method '.version_select at 0x7f7e44a10e50>' {{(pid=124190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 19:08:07.646423 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO nova.api.openstack.requestlog [None req-8238c7e0-c49c-4d2d-8cd0-a02e300c617d tempest-TestVolumeBootPattern-1070629529 tempest-TestVolumeBootPattern-1070629529-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-339444055" status: 202 len: 0 microversion: 2.1 time: 0.026605 Jun 20 19:08:07.647307 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: [pid: 124190|app: 0|req: 633/1271] 10.222.0.43 () {58 vars in 1259 bytes} [Mon Jun 20 19:08:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-339444055 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 19:09:41.548620 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:09:41.549209 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Mon Jun 20 19:09:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:10:01.501294 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:10:01.502042 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Mon Jun 20 19:10:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:11:11.736541 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:11:11.737001 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Mon Jun 20 19:11:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:11:20.970348 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:11:20.970907 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Mon Jun 20 19:11:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:13:01.556562 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:13:01.557190 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Mon Jun 20 19:13:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:13:15.706158 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:13:15.706724 dv-cinder-836973-6-iscsi devstack@n-api.service[124190]: Mon Jun 20 19:13:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:13:21.509503 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:13:21.510104 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Mon Jun 20 19:13:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 19:13:35.560051 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 19:13:35.560847 dv-cinder-836973-6-iscsi devstack@n-api.service[124189]: Mon Jun 20 19:13:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!